ETH Zürich starts its collaboration with Sony Developer World and Sony Semiconductor Solutions Corporation

JonasJonas

Sony Developer World and Sony Semiconductor Solutions Corporation announce starting their collaboration with ETH Zürich, Department of Information Technology and Electrical Engineering. The collaboration is part of Sony’s Sensing Solution University Program, which is designed to build partnerships with university research groups that develop innovative and useful ways of using Spresense, Vision Sensing Processor microcontrollers, and sensors from Sony and other companies.

The research group of ETH Zürich will collaborate with Sony while working on a project that aims to study and develop the basis for a new generation of deep learning engines. The study will be applied to design an autonomous drone that will be used in modern agriculture, to analyze the soil and farmland.

”The research project aims at striking a balance between exploring generally applicable research ideas and developing a concrete demonstrator, i.e. a system containing complete physical embodiments of a new class of all-powerful intelligent devices and embedded and tiny deep learning systems”, said Dr. Michele Magno, Head of the D-​ITET Center for Project-​Based Learning at Department of Information Technology and Electrical Engineering of ETH Zürich.

The ETH Zürich research group includes:

  • Michele Magno, Senior Scientist and Lecturer at the Department of Information Technology and Electrical Engineering (D-ITET) of ETH Zürich, Switzerland. Since 2020, he has lead the D-ITET center for project-based learning at ETH. His current research interests include smart sensing, low power machine learning, wireless sensor networks, wearable devices, energy harvesting, low power management techniques, and extension of the lifetime of batteries-operating devices.
  • Seonyeong Heo, Postdoctoral Researcher at D-ITET Center for Project-Based Learning of ETH Zürich. She received her BSc. and Ph.D. degrees in Computer Engineering from POSTECH, South Korea, in 2016 and 2021. Her research interests include machine learning on embedded systems, real-time embedded systems, and compiler optimization.
  • Nicolas Baumann, Scientific Assistant at D-ITET Center for Project-Based Learning of ETH Zürich. He received his B.Sc. and M.Sc. degrees in Electrical Engineering and Information Technology from ETH Zürich, Switzerland, in 2019 and 2021. His research regards computer vision and machine learning for autonomous flying and driving on resource-constrained devices.

The first phase of the project will be to design deep learning algorithms that will further be used on building the drone and on studying its performance. This will be followed by creating the hardware design of the drone. Extensive details on the further phases of the project will be updated on our website.

More information:

Spresense