MPEG-H-3D, la competencia de Dolby ATMOS y DTS:X

Interesante. Estaría bien saber si utiiliza compresión con pérdida de calidad o si se trata de sonido lineal no comprimido, y a qué bitrates/frecuencias de muestreo trabaja.

Como es para transmision en televisoras y streaming sera con compresion con perdida, aunque tambien contara con compresion sin perdida significativa, ya que segun entiendo seria similar al nuevo formato AC-4 de Dolby [mejor uso del bitrate, uso de bitrates bajos conservando mucho de la fildelidad], ademas del soporte de metadatos para posicionamiento de objetos acusticos, similar al de ATMOS/X.

hilo_dolby-digital-ac-4-el-equivalente-a-h265-av1-en-audio_2361779

Y lo interesantes es que al ya estar aprobadas sus caracteristicas y tener una version final [o mejor dicho, inicial], en el futuro a cercano plazo deberan aparecer los aparatos de audio y video compatibles con este formato, ademas de que quiza los AVR HT recientes puedan; via una actualizacion del firmware, soportarlo.


.

Desde los laboratorios de Fraunhofer, ponen a disponibilidad gratuita el plugin para crear contenido en este nuevo formato de audio. Compatible para el estandar VST 3 y AAX, con lo que cualquier editor de audio que pueda usar plugins VST3/AAX podra emplearlo.

https://www.iis.fraunhofer.de/en/ff/amm ... mhapi.html

MPEG-H Authoring Plug-In 3.0

The MPEG-H Authoring Plug-in (MHAPi) gives you the opportunity to create immersive and interactive MPEG-H Audio scenes inside a VST3 or AAX enabled Digital Audio Workstation (DAW). With its unique personalization features, the MPEG-H Audio system offers fully user-adjustable dialogue level, customizable audio description, multiple languages, and even interactive object positioning, allowing the media consumption experience to be tailored to individual preferences and needs.

MPEG-H delivers enveloping immersive sound and unprecedented customization options, regardless of the playback device – from home theatres to 3D soundbars to mobile devices. The MPEG-H Authoring Plug-in is a powerful tool that takes you through all the steps of creating object- or channel-based MPEG-H productions, all the way to the export to either MPEG-H production format (MPF) or BWF/ADM, containing audio and metadata, ready for distribution via MPEG-H enabled channels.

This version introduces the all-new Dynamic Gain Sequences feature. Through Dynamic Gain Sequences, you are enabled to provide multiple ducking-versions of a background track to match different dialog languages or to provide accessibility features via metadata, making the transmission of multiple bed-mixes obsolete.

The new Version 3.0
- Combination of channel-based components and dynamic audio objects
- 3D panning and 3D position automation of dynamic objects for immersive content
- Dynamic Gain Sequences
- Enabled interactivity on component gain and position for an interactive user experience
- Possibility to create labels in multiple languages for audiences all over the world
- In depth documentation and template sessions for Pro Tools, Nuendo, Reaper and Sequoia
- Export to MPEG-H Production Format or BWF/ADM

Y del mismo MPEG y Fraunhofer HHI ya tenemos los pasos finales para que salgan encoder y decoders para el nuevo formato de video MPEG-4 VVC [aka h266]

hilo_fraunhofer-versatile-video-coding-h266-el-rival-para-av1_2384839#p1749693789


.

MPEG y Fraunhofer HHI licencian el PERFIL BASELINE


AL plicenciar este perfil se establece ya un estandar basico para la codificacion de streams de audio con este formato, y de la misma manera se establecen los requerimientos para implementar el decodificador para uso domestico que reproduzca de manera eficiente y precisa el audio de este formato.


Dr. Bernhard Grill, Director of Fraunhofer IIS
The MPEG-H 3D Audio Baseline Profile has been designed by ISO/IEC MPEG to deliver the most convincing immersive and interactive audio consumer experience. By cutting the implementation and testing effort by up to fifty percent, while enabling at the same time support for up to 24 audio objects, the MPEG-H 3D Audio Baseline Profile is exactly meeting the industry requirements. Its streamlined set of tools also allows for an attractive licensing program.

El perfil de audio base MPEG-H 3D ha sido diseñado por ISO / IEC MPEG para ofrecer la experiencia de audio inmersiva e interactiva más convincente para el consumidor. Al reducir el esfuerzo de implementación y prueba hasta en un cincuenta por ciento, al tiempo que permite la compatibilidad con hasta 24 objetos de audio, el Perfil de línea de audio 3D MPEG-H cumple exactamente con los requisitos de la industria. Su conjunto simplificado de herramientas también permite un atractivo programa de licencia.,

https://www.iis.fraunhofer.de/en/pr/202 ... ofile.html

Soporte completo en MediaInfo 20.08 para este formato de audio, soporta todos los perfiles de codificacion.


.

FFmpeg 4.3

Soporte a MPEG-H-3D para la decodificacion desde contenedor MP4, falta ver le den soporte a MKV.

Surprisingly dubbed “4:3”, the FFmpeg 4.3 release comes with Vulkan support, Intel QSV-accelerated MJPEG and VP9 decoding, support for the AMD AMF encoder on Linux via the Vulkan API, VDPAU VP9 hardware acceleration, TrueHD and MPEG-H 3D audio support for in MP4, and support for Sipro ACELP.KELVIN decoding.

Las compañias Denon, Polk Audio, Marantz, Definitive Technology, HEOS, Classe y Boston Acoustics, han comunicado que emplearan el formato de audio desarrollado por Fraunhofer IIS y MPEG en sus proximos modelos de AVR HT

Kazuma Okada, Vice President APAC Commercial Operation:
Sound United abides by a philosophy of giving customers all the tools they need to derive maximum enjoyment from their products. By adding support for the MPEG-H 3D Audio format to our home theater products in key markets, Sound United customers garner another avenue to greater immersive and interactive experiences delivered by this next-generation audio system.


Bernhard Grill, Director of Fraunhofer IIS
We are extremely pleased the MPEG-H 3D Audio standard is now being made available to consumers on Denon and Marantz AVRs. We’ve always aimed to create a feeling of ‘being there’ in the stadium or the concert venue with Fraunhofer’s audio innovations, and Sound United has been an excellent partner in this endeavor.


Denon & Marantz AVR models with MPEG-H support
Applicable Denon models
AVC-A110, AVC-X8500H, AVC-X6700H, AVC-X4700H

Applicable Marantz models
AV8805, AV7706, SR8015, SR7015
https://www.businesswire.com/news/home/ ... Components

El sistema operativo webOS TV 5.0 da soporte a este nuevo formato de audio, asi como su contraparte de dolby

Dolby AC-4 and MPEG-H 3D
http://webostv.developer.lge.com/discov ... /webos-50/

Algo de informacion util para entender como funciona los nuevos formatos de audio/video con metadatos para su mejor empleo dependiendo del entorno donde se reproducen. AUnaque el texto es especificfo para el formato de audio MPEG-H-3D, se puede extrapolar a otros formatos de audio como dolby ac-4 y dolby atmos o el de video de dolby vision

https://tech.ebu.ch/nga

MediaInfo en su reciente version pone correcion en la deteccion de stream mpeg-H-3D, y tambien es la ultima version compatible con winXP.

Ahora cuenta copn presets que ajustan lños algoruitmos de reproduccion adecuando el audio dependiendo del tipo de video; o de videojuego, asi como del tipo de aparato de audio

Software de autoria
https://www.youtube.com/watch?v=e91MG2KJz-c

Uy, en brasil parece que van muy en serio para adoptar este formato de audio.

Han abierto un centro de 'entrenamiento' para capacitar a los encargados del audio de las televisoras y compañias productoras en como utilizar y obtener el maximo beneficio que ofrece MPEG-H-3D, ademas de que la empresa Sumavision; en Sao Paulo, ha adoptado la compra de licencias para dotar sus producciones en UHD con este formato de sonido.


.

Para crear plugins y complementos que permitan el uso de MPEG-H 3D AUDIO en editores de audio.

Fraunhofer ADM Info Tool
Highlights of Version 1.0.0
- Conformance checking of ADM and S-ADM metadata according to ITU-R BS.2076-2, ITU-R BS.2088-1 and ITU-R BS.2125-0
- Validation of ADM-based content against ADM profiles that can be ingested into the MPEG-H Audio System
- Detailed reports on XML parser and conformance issues
- Supported input formats

Technical Details and Requirements
- Supported operating systems
** macOS 10.13 or newer
** Windows 10 or newer
- Intel-compatible CPU (minimum 2GHz recommended)
- Memory: 2GB RAM

Plugin VST3 para crear sonido envolvente y en MPEG-H-3D
Spatial Audio Designer


- Plug-in for any professional application such as music, film, game, sound design, VR/360 and multimedia.
- Mixing and monitoring with real loudspeakers and common headphones.
- All common 2D audio formats like stereo, 5.1 and 7.1 are available.
- Support for all current and future 3D channel layouts (formats) like IMAX, 2+2+2+2, Dolby Atmos, MPEG-H, Auro-3D, DTS:X and 22.2.
- Custom channel layouts are possible by users or on demand for presentations and special venues.
- Unlimited amount of input sources usable.
- Up to 330 outputs available
- Advanced output monitoring and calibration for any format
- Flexible OSC I/O interface
- Object export (audio and metadata) of complete mixes
- Exports to any channel format
- Independent of the host bus structure => works in stereo audio and some video workstations too.
- Import of DAW (digital audio workstaion) automation data.
- Licencing to computer hardware and/or standard USB stick (no special dongle).
- High-end binaural processing by New Audio Technology.
- Sampling rates: 44.1 kHz, 48 kHz. 88.2 kHz and higher are possible but not guaranteed. Depends on host DAW, OS and system.
- Complete MPEG-H authoring, monitoring, export and encode.
- Virtual busses (enable mixing different formats at the same time)
- Auto routing => modules are connected instandly
- Host track name takeover in certain DAW versions.
- All Dolby Atmos bed channel array configurations.
- Panner GUI in Send module (source track module)
- Scalable and adjustable GUI.
- Box and sphere mode
- Collapsing editing boxes.
- Enhanced processing to save CPU consumption.
- Retina display support.
- I/O level display in the Send modules.
- Send level display.
- Enhanced mouse over parameter display and editing.
- Processing sync indicator.
- Internal buffer size management.





.

Un encoder para MPEG-H-3D de uso libre
https://mpeg.chiariglione.org/sites/def ... 3412_0.zip


www.ittiam.com/delivering-immersive-3d-audio-with-ittiams-optimized-mpeg-h-decoder

Y tratan de introducirlo como estandar para el tema de Realidad Virtual y Realidad Aumentada

Y ya esta saliendo informcacion para como se trabajan los Objetos de audio y la estandarizacion de ecualizaciones para aprovechar este formato de audio.
https://www.nhk.or.jp/strl/english/publ ... 0/1/5.html

Android 12 con soporte nativo para MPEG-H-3D



Android 12 sera compatible de manera nativa con este formato de sonido, por lo que Sony lo usara como base para su sistema de sonido '360 Reality Audio', y con esto en mente es que Sony piensa poder ampliar los dispositivos compatible scon 360 Reality Audio como smartphones, tablets, TVBox con android y en si smartTV y SmartReproductores multimedia con android TV.

De esta manera esos dispositivos android seran compatibles con sistemas de sonido como Audio-Technica, barras de sonido de Sennheiser, procesadores AV de McIntosh y altavoces Amazon Echo Studio u otros dispositivos con certificacion 360 Reality.

Y aun sigue avanzando

Sony se une oficialmente al grupo que apoya este formato, adquiriendo licencias de uso de software para la codificacion yd ecodificacion a este formato de audio. Con esto varios de sus productos actuales y futuros podran hacer uso de este sistema de audio envolvente, que de hecho, es ya parte de sus sistema de audio de inmersion 360°

Business Department and Deputy Division, Sony Corporation escribió:The partnership with Fraunhofer on MPEG-H 3D Audio allows us to enable 360 Reality Audio and MPEG-H 3D Audio in a wide variety of products from Sony. We expect to expand the ecosystem of 360 Reality Audio together with Fraunhofer.

We look forward to many exciting Sony consumer products that will also support the playback of MPEG-H 3D Audio from other content services.

libmpegh

Ya tenemos una API de codigo libre para la decodificacion de este formato de audio, el cual podra ser incorporado por esos proyectos libres de reproductores y centros multimedia [sin decir su empleo en aparatos reproductores integrados]

Introduction of the MPEG-H 3D Audio Low Complexity Profile Decoder

The advent of object-based audio and scene-based audio has revolutionized the 3D sound experience. Traditional channel-based coding expects the capture and playback geometric locations to be exactly the same for best reconstruction of the audio scene. On the other hand, object-based audio coding represents discrete sound sources in the audio scene. The positional information of each of the objects in the audio scene is conveyed in the form of metadata. Scene-based audio coding attempts to reconstruct the sound field at the playback end using the coded higher order ambisonics (HOA) information. In case of both object-based and scene-based audio, the rendering algorithm can adapt based on the configuration of the playback end loudspeaker arrangement, thus making the sound experience agnostic to the configuration of speakers at the playback end.

MPEG-H 3D Audio is a coding standard that supports traditional channel-based, object-based and scene-based audio coding. The immersive 3D sound experience created by MPEG-H 3D Audio is significantly enhanced in comparison with the traditional channel-based multichannel programs and playback systems.

Mediatek agrega soporte nativo a este formato en sus procesadores Pentonic 2000, SoCs pensados para la televisores inteligentes.

MediaTek is also among the first to support the latest VVC (h.266) standard and with native support for MPEG-H Audio, the Pentonic 2000 becomes the first TV Platform adhering to Brazil’s Next Generation broadcast system, currently under specification by the Fórum Sistema Brasileiro de Televisão Digital (SBTVD Forum).
“With Pentonic, MediaTek offers a comprehensive global demodulation platform for receiving OTA broadcasts from all major standards including DVB, ATSC, and ISDB-T,” said Alfred Chan, Vice President of the TV Business Unit at MediaTek. “This makes it suitable to meet the existing specifications in Brazil, providing TV manufacturers with MPEG-H Audio support for today’s TV 2.5 broadcasts, as well as with the future TV 3.0”.

Pus en este mundial de Catar [qatar], hay varias televisoras que estan usnado MPEG-H como formato de audio estandar en sus transmisiones, y de manera experimental alguno que otro con audio envolvente 3D

Encoder -oficial de mpeg- para audio MPEG-H-3D

https://mpeg.chiariglione.org/sites/def ... 3412_0.zip

Y ahora el reto es agregar IA al esquema de produccion de mezcla de audio spatial 360°

Los investigadores del Moving Picture Experts Group estan viendo la manera ded poder agregar un sistema de inteligencia artificial que ayude al ingeniero/compositor de audio 3D para crear los anbientes de sonido envolvente de una manera mas sencilla, practica y hasta instintiva.

Amazon Music implementa el uso del formato de audio MPEG-H-3D para su servicio via 360 Reality Audio

Fraunhofer has a long and successful history of providing best-in-class automotive audio solutions to the industry. The availability of 360 Reality Audio content from Amazon Music in cars is the perfect match to the advancements in audio rendering capabilities that we’ve been striving for.

https://www.ibc.org/features/dolby-ac-4 ... 04.article

Software oficial para la decodificacion
-->github.com/Fraunhofer-IIS/mpeghdec