Contact us

在新視窗打開 在新視窗打開

東芝推出全新陣容的車用影像識別處理器

利用單眼攝影鏡頭可捕捉夜間行人偵測及3D重建: TMPV7608XBG

This is a photo of TMPV7608XBG.

TMPV7608XBG是Visconti™4(TMPV760)系列的新增產品,主要優化用於下一代先進駕駛輔助系統(ADAS),它要求新車輛具備在白天和夜間防止撞上行人的安全功能,該功能將成為歐盟新車安全評鑒協會(Euro NCAP)的評估要素。

產品特色

東芝原創圖像識別技術採用顏色特徵

This is an image of detecting at night-time by color feature value pattern recognition.

TMPV7608XBG使得ADAS在夜間識別行人的可靠性能夠與使用傳統視覺系統在白天識別行人的能力相媲美。東芝原創的增強型CoHOG(方向梯度共現長條圖)加速器融合了基於亮度的CoHOG特徵描述符和使用全新開發技術獲得的基於色彩的特徵描述符。該增強性能實現了識別精度的巨大改進,特別是在夜間或者目標物件與背景的亮度差較小的情況下。且,增強型CoHOG加速器提供卓越的計算性能,可縮短識別所需要的時間。

利用3D重建技術偵測一般障礙物

TMPV7608XBG採用了運動架構(SfM)加速器,它實現了對於墜落物體和滑坡等一般靜止障礙物的檢測。SfM加速器將根據從單眼鏡頭獲得的圖像序列對到達靜止障礙物的距離、障礙物的高度和寬度進行三維(3D)估計。加速器能夠在不需要學習曲線的情況下檢測所有靜止障礙物、移動物體(通過運動分析)、行人及車輛等特殊物件(通過圖形識別)。使用3D資訊有助於縮小識別物件中的興趣區域(ROI),從而改進了圖形識別速度,能提供更快速的駕駛輔助和控制。

This is an explanatory diagram of the general obstacle detection using 3D reconstruction technology.

並存執行最多達8個影像識別應用

TMPV7608XBG採用了8個名為媒體處理引擎(MPE)的全新影像處理引擎,雙精度浮點單元,以及各種影像處理加速器(總數達14個),其影像處理性能是傳統產品的10倍*。因此,TMPV7608XBG實現了最多8個影像識別應用的並存執行。所有影像處理引擎和加速器能夠在50毫秒內同時識別行人和車輛,其運行的時鐘頻率高達266.7MHz。

* 與前一代東芝型號比較

This is an example of simultaneous, parallel execution of multiple applications.

處理時間減少一半

This is a comparison diagram of image recognition processors performance.
A performance comparison of a new and conventional products

基本系統架構

This is the basic system configuration example of image recognition processor (TMPV7608XBG).

* The video input interface of the TMPV7608XBG has a 4-of-8 video switch.

Example of the basic system configuration for the TMPV7608XBG

產品規格

Series Name / Product Name Visconti4 / TMPV7608XBG
CPUs Toshiba original 32-bit RISC
Media embedded Processor (MeP) x 2 sets
Image Processing Engines Toshiba original 32-bit RISC Media Processing Engine
Media Processing Engine (MPE) with Double-precision
FPU x 8 sets with 256 KB L2 cache x 2 sets
Image Processing Accelerators Affine Transformation 3 ch (Lens Undistortion, Affine Transformation, Viewpoint Conversion, etc.)
Filter 2 ch (Smoothing, Edge Detection, Corner Detection, Oriented Gradient Computation, Color Space Conversion, Demosaicing, etc.)
Histogram 1 ch (Histogram, Image Conversion using LUT, etc.)
Histogram of Oriented Gradients(HOG) 1 ch (HOG/CoHOG Features + Linear Support Vector Machine)
Enhanced CoHOG 2 ch (HOG/CoHOG/Color-CoHOG Features etc. + Linear Support Vector Machine)
Matching 2 ch (Tracking, Motion Detection)
Pyramid 2ch (Pyramid Image Generation)
Structure from Motion (SfM) 1ch (3D Reconstruction)
On-chip Memories Masked ROM 80 KBytes
SRAM 1632 KBytes
On-chip Peripherals Video Input Interface Up to 8 ch (CMOS I/F: Up to 4 ch / max. SXGA, 60fps | MIPI® CSI-2 I/F: Up to 4ch / max. 1080p, 60fps) with Video Switch (8-input to 4-select)
Video Output Interface 1 ch
External Memory Controllers DDR SDRAM Controller LPDDR2-800
Serial NOR Memory Controller (Single or Quad SPI)
Parallel SRAM / NOR Memory Controller
External MCU Interface 1 ch (8-bit bidirectional parallel input/output)
General-Purpose I/O 24-bits
CAN Controllers 3 ch
I2C Interface Up to 8 ch
UART Interface Up to 5 ch (1ch for debug use only)
SPI Interface Up to 4 ch
PCM Interface Up to 2 ch
Timer / Counters 32 ch
Operating Frequency 266.7 MHz max.
Operating Voltage Core: 1.1 V,
I/O: 3.3 V, 1.2 V (for LPDDR2 SDRAM) / 1.2V (MIPI® CSI-2 I/F)
Package P-FBGA 796-ball, 27mm x 27mm, 0.8 mm ball pitch
Product List

Product Lineup (Parametric Search)
View the product list of image recognition processors to find products that meet your performance specifications.

A reference board of Image Recognition Processors.
We have a wide variety of development tools, a software development kit (SDK) and reference boards are available.

* MIPI is a registered trademark owned by the MIPI Alliance.

* Microsoft and Windows are either registered trademarks or trademarks of Microsoft Corporation in the United States and/or other countries.

* Red Hat and Enterprise Linux are registered trademarks of Red Hat, Inc. in the United States and other countries.

* HDMI is a trademark or registered trademark of HDMI Licensing, LLC in the United States and/or other countries.

* MediaLB and MOST are registered trademarks of Microchip Technology Inc. in the United States and other countries.

* Arm and Cortex are registered trademarks of Arm Limited (or its subsidiaries) in the US and/or elsewhere.

* All other company names, product names, and service names mentioned herein may be trademarks of their respective companies.

聯繫方式

如您需查詢,請點擊其中任何一個連結

技術方面的問題
購買、樣片和IC可靠性的相關諮詢
To Top
·Before creating and producing designs and using, customers must also refer to and comply with the latest versions of all relevant TOSHIBA information and the instructions for the application that Product will be used with or for.