Ambarella is a semiconductor company that most users have never heard of as much as Intel, AMD, and Qualcomm; But it’s probably one of the company’s video-based processors on one of your current devices. At CES 2021, for example, one of Umbrella’s on-chip system (SoC) appeared on Alarm.com’s video doorbell.

Umbrella has just introduced its latest AI-based visual processor. According to CNET , the processor can  record 8K video at a maximum speed of 60 frames per second and is capable of delivering four 4K streams. 

The CV5 processor, which uses five-nanometer lithography, puts Umbrella CVflow’s AI engine next to two Arm A76 processor cores to do things like 8K video encoding with less than two watts of power. CV5 processing power and low power consumption make this processor an excellent choice for battery-based cameras.

Small devices such as sports and motion cameras (action cameras) will be able to record 8K video at 30 frames per second or 4K video at 240 frames per second thanks to the new Umbrella processor. The CV5 processor uses HDR processing to balance the brightness of extremely bright environments and performs tasks such as image stabilization. All of these processes are performed on the chip itself. The CV5 AI engine can handle tasks such as face monitoring, time-lapse video recording and high ISO imaging at the same time. 

 

Umbrella CV5 processor architecture

 

Umbrella CV5 processor architecture

For 360-degree cameras such as the Insta360 One X2, the Umbrella processor can handle an 8K resolution dual sensor. Like sports and motion cameras, thanks to the CV5, HDR video can be captured on 360-degree cameras, and the chip can also perform the shaking process.

The drones will be able to use the Umbrella CV5 processor for 8K photography and video recording, as well as objects such as object detection and avoidance; they will also be able to track the subject and plan the route thanks to the CV5. 

Related article:

  • Umbrella unveils Vision processors for cars and UAVs

Christopher Dee , vice president of marketing and business development at Umbrella, says it typically takes about a year to get used to devices equipped with the company’s new processors; This means that cameras and drones equipped with CV5 processors will probably be available by the end of this year or early 2022.