As usual in January we start with a look back at the papers we reviewed last year. Paul Cunningham (GM, Verification at Cadence), Raúl Camposano (Silicon Catalyst, entrepreneur, former Synopsys CTO and now Silvaco CTO) and I continue our series on research ideas. As always, feedback welcome. We’re planning on starting a live series this year to debate ideas and broader topics and to get your feedback. Details to follow!
Las selecciones de 2023
These are the blogs we posted through the year, sorted by popularity. We averaged 12.7k engagements per blog, a meaningful increase from last year which we take as an indication that you continue to enjoy our reviews of current research in verification. The leader was no surprise, applying LLMs to automated code review at almost 17k engagements. A close second uses ML to develop model abstractions. In fact the top 4 blogs in 2023 were on all on applications of AI/ML. Petri nets made an appearance again this year, here for validating rapidly evolving DRAM protocols. Using dedicated hardware for speculation in simulation, and a method to find anomalies rounded out the list. The retrospective for 2022 did about as well as usual but was overshadowed by interest in other papers through the year. It is a safe bet we will be looking at more applications of AI/ML in 2024!
Punto de vista de pablo
Another year flies by, and 49 papers read since we started the blog in November 2019! Back then we were thinking it would be a great way to bring together our verification community and show our appreciation for continued investment in verification research at academic institutions around the world.
What I didn’t predict was how reading all these papers would inspire new investments and innovations at Cadence. Writing this blog as has taught me that even at an executive level in engineering, staying connected to ground level research and reading papers regularly is good for business. So thank you readers, and thank you Bernard!
No surprise that our top 3 hits last year were all papers on using AI in verification, one on AI to automate code review (liga), one on AI to help find bugs more quickly in high level SimuLink models of mixed-signal devices (liga), and one on using AI to automatically identify which line of source code is the root cause of a test failure (liga). We absolutely need to continue to invest in research here both in academia and in the commercial world. Somehow, over the next decade we need to find our next 10x in verification productivity, and it’s most likely to come from AI.
That said, my personal shout out from 2024 is not AI related. It’s for two papers in logic simulation: one on parallelizing simulation using speculative execution of the event queue (liga), and the other on improving distribution quality of randomized inputs in constrained random tests using clever hashing functions (liga). I call these “engine-level” innovations –making the building blocks inside EDA tools fundamentally better. We also need to continue research and innovation here. These two papers were very innovative but had nothing to do with AI. Let’s not forget to keep investing in non-AI related innovation as well.
La mirada de Raúl
Writing this retrospective during the holidays inevitably collides with one of humankind’s necessities which can be elevated to an art: eating. Reviewing restaurants perhaps shares enough with reviewing papers to justify ratings such as ★★★ exceptional, worth a special journey, ★★ excellent, worth a detour, ★ high quality, worth a stop, and 😋 exceptionally good at moderate prices. Paul already stated that our September review era un "Michelin star topic”. I will continue in this vein, using your preferences (number of views), dear readers, as the yardstick.
While last year’s blog was largely about cool algorithms, this year’s was about AI / ML y Software (SO). The top three ★★★ papers were all about verification of SW using AI/ML. The top rated blog (Julio) was about code review with generative AI, the second (Noviembre) dealt with testing and verifying SW for Cyber-Physical Systems using surrogate AI models, and the third (De Mayo) was about detecting and fixing bugs in Java augmenting with AI classifiers. Two of these three papers use large datasets from GitHub for training. Such data is not available publicly for hardware (HW) design; which is arguably different enough from SW to at least raise the question whether these results can/will be replicated for HW. Nevertheless, looking at what the SW community is doing about verification is certainly a source of inspiration.
The next three papers, ranked with ★★, are an eclectic collection of AI/ML, a very cool algorithm, and Petri-Nets. All deal with verification in EDA. septiembre de paper was a preview on using a LLM (GPT-4) and a model checker (JasperGold) to translate English into System Verilog Assertions (SVA). The next one (Junio) addressed how to sample the solution space for constrained random verification uniformemente (meeting the constraints) – a cool algorithm for a hard problem, back from 2014. The last contribution in this group (Abril) extended Petri Nets for the verification of JEDEC DDR specifications; it is educational both on JEDEC specs and Petri Nets, and uncovers one timing violation.
Papers 7-9, ranked with ★, deal with analog design verification, CPU verification and parallel SW execution. In Octubre we reviewed an invited paper to the IEEE open journal of the Solid-State Circuits Society, besides being a good tutorial on analog design and validation, the main contribution consists of replacing analog circuit models by functional models to accelerate Spice simulation by 4 orders of magnitude. February’s paper was about using DNNs to improve random instruction generators in CPU verification, showing a reduction of “el número de simulaciones por un factor de 2 más o menos” in a simple example (IBM Northstar, 5 instructions). Marzo brought us the complete design of a HW accelerator to implement the Modelo de ejecución de tareas ordenadas ubicadas espacialmente (SLOT) to exploit parallelism and speculation, and for applications that generate tasks dynamically at runtime.
Which leaves us with two 😋 recipients. In Agosto we reviewed a paper from 2013 which pioneered k-means clustering (2013) for post silicon bug detection. And in Diciembre we looked at a very important topic, security verification using IFT (Information Flow Tracking) and it’s extension from gate level to RTL. Not surprisingly, December’s contribution got the least hits as our readers were probably facing the dilemma described initially.
Ratings can be arbitrary at times, all these contributions are star worthy and advance the state of the art. We can be grateful for an active, international research community in academia and industry tackling really hard problems. As of my personal preferences, you can guess…
Comparte esta publicación a través de:
- Distribución de relaciones públicas y contenido potenciado por SEO. Consiga amplificado hoy.
- PlatoData.Network Vertical Generativo Ai. Empodérate. Accede Aquí.
- PlatoAiStream. Inteligencia Web3. Conocimiento amplificado. Accede Aquí.
- PlatoESG. Carbón, tecnología limpia, Energía, Ambiente, Solar, Gestión de residuos. Accede Aquí.
- PlatoSalud. Inteligencia en Biotecnología y Ensayos Clínicos. Accede Aquí.
- Fuente: https://semiwiki.com/eda/341102-2023-retrospective-innovation-in-verification/
- :posee
- :es
- :no
- 12
- 2013
- 2014
- 2022
- 2023
- 2024
- 49
- a
- Nuestra Empresa
- absolutamente
- Academia
- académico
- acelerar
- acelerador
- lector activo
- dirigido
- avanzar
- de nuevo
- AI
- Modelos AI
- AI / ML
- algoritmo
- algoritmos
- Todos
- casi
- ya haya utilizado
- también
- hacerlo
- an
- y
- aplicaciones
- La aplicación de
- apreciación
- somos
- sin duda
- en torno a
- Arte
- AS
- At
- automatizado
- Confirmación de Viaje
- automáticamente
- Hoy Disponibles
- Atrás
- BE
- "Ser"
- además de
- Bet
- mejores
- Bloques
- Blog
- Blogs
- ambas
- llevar
- más amplio
- Traído
- Error
- loco
- Construir la
- pero
- by
- Cadencia
- llamar al
- PUEDEN
- Catalizador
- Causa
- ciertamente
- Cerrar
- clustering
- código
- Revisión de código
- --
- cómo
- completo
- vibrante e inclusiva
- completar
- conectado
- consiste
- restricciones
- continue
- continuado
- contribución
- contribuciones
- Frio
- CPU
- CTO
- Current
- datos
- conjuntos de datos
- acuerdo
- Estimado
- debate
- década
- a dedicados
- descrito
- Diseño
- detalles
- Detección
- desarrollar
- Dispositivos
- HIZO
- una experiencia diferente
- do
- "Hacer"
- durante
- dinamicamente
- ecléctico
- educativo
- elevado
- compromisos
- Ingeniería
- Inglés
- disfrutando
- suficientes
- Emprendedor
- Incluso
- Evento
- evolución
- ejemplo
- excelente,
- Servicio
- excepcionalmente
- ejecución
- ejecutivos
- Explotar
- extendido
- extensión
- tener problemas con
- hecho
- factor
- Fracaso
- realimentación
- Encuentre
- de tus señales
- Ex
- Desde
- funcional
- funciones
- fundamentalmente
- portón
- generar
- generativo
- IA generativa
- generadores
- obtener
- GitHub
- GM
- candidato
- tiene
- agradecido
- maravillosa
- Polo a Tierra
- Grupo procesos
- tenido
- Difícil
- Materiales
- Hashing
- ayuda
- esta página
- Alta
- Golpes
- días festivos
- Cómo
- Como Hacer
- HTTPS
- i
- IBM
- ideas
- Identifique
- IEEE
- implementar
- importante
- mejorar
- la mejora de
- in
- En otra
- aumente
- indicación
- energético
- inevitablemente
- información
- posiblemente
- Innovation
- innovaciones
- originales
- entradas
- dentro
- Inspiración
- inspiren
- instituciones
- Instrucciones
- intereses
- Internacional
- dentro
- Invertir
- metas de
- inversión extranjera
- Inversiones
- invitado
- IT
- Enero
- Java
- revista
- Guardar
- large
- principalmente
- Apellido
- El año pasado
- líder
- menos
- Nivel
- que otros
- línea
- Lista
- para vivir
- situados
- lógica
- Mira
- miró
- mirando
- hecho
- Inicio
- max-ancho
- me
- significativo
- reunión
- Método
- ML
- modelo
- modelos
- moderada
- más,
- MEJOR DE TU
- my
- artículos de necesidad
- ¿ Necesita ayuda
- Nets
- sin embargo
- Nuevo
- Next
- no
- nada
- Noviembre
- ahora
- número
- of
- on
- ONE
- habiertos
- or
- en pedidos de venta.
- Otro
- nuestros
- salir
- Más de
- Papel
- papeles
- Paralelo
- Paul
- para
- quizás
- con
- Petri
- pionero
- planificar
- Platón
- Inteligencia de datos de Platón
- PlatónDatos
- popularidad
- Publicación
- publicado
- predecir
- preferencias
- Vista previa
- Precios
- probablemente
- Problema
- problemas
- productividad
- protocolos
- en público
- calidad
- pregunta
- con rapidez
- aumento
- azar
- Aleatorizado
- clasificado
- rápidamente
- Calificación
- Calificaciones
- Leer
- lectores
- Reading
- realmente
- destinatarios
- reducción
- regularmente
- relacionado
- replicado
- la investigación
- investigación e innovación
- Comunidad de Investigación
- Restaurantes
- Resultados
- una estrategia SEO para aparecer en las búsquedas de Google.
- revisado
- la revisión
- Reseñas
- raíz
- ambiente seguro
- Said
- Segundo
- EN LINEA
- Serie
- Acciones
- Mostrar
- demostración
- Silicio
- sencillos
- simulación
- simulaciones
- desde
- espacio
- So
- Sociedades
- a medida
- de algun modo
- Fuente
- código fuente
- Espacio
- especial
- Especificaciones
- especificaciones
- especulación
- especulativo
- especia
- Estrella
- comienzo
- fundó
- Comience a
- Estado
- dijo
- quedarse
- Detener
- tal
- sorpresa
- te
- Todas las funciones a su disposición
- abordando
- ¡Prepárate!
- tareas
- enseñó
- test
- Pruebas
- pruebas
- agradecer
- esa
- El proyecto
- El Estado
- el mundo
- luego
- Estas
- Ideas
- Código
- así
- este año
- Tres
- A través de esta formación, el personal docente y administrativo de escuelas y universidades estará preparado para manejar los recursos disponibles que derivan de la diversidad cultural de sus estudiantes. Además, un mejor y mayor entendimiento sobre estas diferencias y similitudes culturales permitirá alcanzar los objetivos de inclusión previstos.
- veces
- sincronización
- a
- juntos
- parte superior
- tema
- Temas
- Seguimiento
- Formación
- la traducción
- tutoriales
- dos
- us
- utilizan el
- usos
- usando
- usual
- validando
- validación
- Verificación
- verificando
- muy
- vía
- vistas
- INCUMPLIMIENTO
- fue
- Camino..
- we
- bienvenido
- WELL
- tuvieron
- ¿
- sean
- que
- seguirá
- mundo
- valor
- digno
- se
- la escritura
- año
- Usted
- tú
- zephyrnet