Introduction

Welcome to my weekly report documenting my journey during Google Summer of Code 2023 with the Linux Foundation! In this project, I am working on enhancing the existing speech-to-text feature of Automotive Grade Linux (AGL) by introducing a Natural Language Intent engine and implementing software daemons/controllers to execute the extracted intent. This endeavor aims to significantly improve the user experience and functionality of the speech-to-text feature in automotive environments. Throughout this report, I will share my progress, challenges faced, and achievements made as I contribute to the development of AGL and pave the way for more intuitive and intelligent voice interactions in automobiles.

Summary of the week

In the past week, substantial progress was made in both the Voice Assistant Flutter App and the Voice Agent gRPC Service. Key achievements include successful testing of the app's basic UI on the AGL target image and executing mapped VSS signals with the kuksa_client in the Voice Agent gRPC Service. However, challenges were encountered during the Flutter app's recipe build, requiring resolution. The documentation of the project also continued to evolve, and the voiceagent-service was uploaded to Gerrit for review.

Tasks completed

• Voice Assistant Flutter App

  • Conducted testing of the basic App UI on the target AGL image, validating the app's functionality in the target environment.
  • Tested the Dart client's integration with gRPC on the AGL target image. Encountered a recipe build error related to heap space exhaustion, as evidenced by the following error message (cropped):

    do_archive_pub_cache: Error executing a python function in exec_func_python() autogenerated:
    === Crash occured when compiling dart:async__SuspendState@4048458__handleException@4048458 in unoptimized JIT mode in unknown pass
    === Flow Graph not available
    Aborted (core dumped)
    Exhausted heap space, trying to allocate 92672 bytes.
    ../../runtime/vm/virtual_memory_posix.cc: 557: error: mprotect error: 12 (Cannot allocate memory)
    

• Voice Agent gRPC Service

  • Successfully executed the mapped VSS signals using the kuksa_client. Following signals were included:
    • "Vehicle.Cabin.Infotainment.Media.Volume"
    • "Vehicle.Cabin.HVAC.Station.Row1.Left.FanSpeed"
    • "Vehicle.Cabin.HVAC.Station.Row1.Right.FanSpeed"
    • "Vehicle.Cabin.HVAC.Station.Row1.Left.Temperature"
    • "Vehicle.Cabin.HVAC.Station.Row1.Right.Temperature."

• Documentation Continuation: Continued the work on documenting the entire project, ensuring comprehensive coverage of its architecture, usage, and configuration.

• Gerrit Upload: Uploaded the voiceagent-service to Gerrit for review.

Tasks leftover

No tasks were leftover this week.

Next steps

In the upcoming week, the following tasks will be undertaken:

• Resolve Flutter App Recipe Build Issues: Address and resolve the bitbake recipe build issues encountered during the Flutter app's integration with the AGL target image. This is crucial for ensuring the app's compatibility and functionality in the target environment.
• Documentation Progress: Continue the documentation efforts, aiming to provide a comprehensive resource that outlines the project's technical aspects, setup procedures, and usage guidelines.

Conclusion

Overall, this week was productive, and I am satisfied with the progress made in achieving the goals outlined for the week. I am excited to continue my GSoC journey and further enhance the speech-to-text feature in Automotive Grade Linux.

Resources

There were no resources found attached to this post.