#ROS2

[govindhtech]

ROSCon 2024: Accelerating Innovation In AI-Driven Robot Arms

NVIDIA Isaac accelerated libraries and AI models are being incorporated into the platforms of robotics firms.

NVIDIA and its robotics ecosystem partners announced generative AI tools, simulation, and perceptual workflows for Robot Operating System (ROS) developers at ROSCon in Odense, one of Denmark’s oldest cities and a center of automation.

New workflows and generative AI nodes for ROS developers deploying to the NVIDIA Jetson platform for edge AI and robotics were among the revelations. Robots can sense and comprehend their environment, interact with people in a natural way, and make adaptive decisions on their own with generative AI.

Generative AI Comes to ROS Community

ReMEmbR, which is based on ROS 2, improves robotic thinking and action using generative AI. Large language model (LLM), vision language models (VLMs), and retrieval-augmented generation are combined to enhance robot navigation and interaction with their surroundings by enabling the construction and querying of long-term semantic memories.

The WhisperTRT ROS 2 node powers the speech recognition feature. In order to provide low-latency inference on NVIDIA Jetson and enable responsive human-robot interaction, this node optimizes OpenAI’s Whisper model using NVIDIA TensorRT.

The NVIDIA Riva ASR-TTS service is used in the ROS 2 robots with voice control project to enable robots to comprehend and react to spoken commands. Using its Nebula-SPOT robot and the NVIDIA Nova Carter robot in NVIDIA Isaac Sim, the NASA Jet Propulsion Laboratory independently demonstrated ROSA, an AI-powered agent for ROS.

Canonical is using the NVIDIA Jetson Orin Nano system-on-module to demonstrate NanoOWL, a zero-shot object detection model, at ROSCon. Without depending on preset categories, it enables robots to recognize a wide variety of things in real time.

ROS 2 Nodes for Generative AI, which introduces NVIDIA Jetson-optimized LLMs and VLMs to improve robot capabilities, are available for developers to begin using right now.

Enhancing ROS Workflows With a ‘Sim-First’ Approach

Before being deployed, AI-enabled robots must be securely tested and validated through simulation. By simply connecting them to their ROS packages, ROS developers may test robots in a virtual environment with NVIDIA Isaac Sim, a robotics simulation platform based on OpenUSD. The end-to-end workflow for robot simulation and testing is demonstrated in a recently released Beginner’s Guide to ROS 2 Workflows With Isaac Sim.

As part of the NVIDIA Inception program for startups, Foxglove showcased an integration that uses Foxglove’s own extension, based on Isaac Sim, to assist developers in visualizing and debugging simulation data in real time.

New Capabilities for Isaac ROS 3.2

Image credit to NVIDIA

NVIDIA Isaac ROS is a collection of accelerated computing packages and AI models for robotics development that is based on the open-source ROS 2 software platform. The forthcoming 3.2 update improves environment mapping, robot perception, and manipulation.

New standard workflows that combine FoundationPose and cuMotion to speed up the creation of robotics pick-and-place and object-following pipelines are among the main enhancements to NVIDIA Isaac Manipulator.

Another is the NVIDIA Isaac Perceptor, which enhances the environmental awareness and performance of autonomous mobile robots (AMR) in dynamic environments like warehouses. It has a new visual SLAM reference procedure, improved multi-camera detection, and 3D reconstruction.

Partners Adopting NVIDIA Isaac 

AI models and NVIDIA Isaac accelerated libraries are being included into robotics firms’ platforms.

To facilitate the creation of AI-powered cobot applications, Universal Robots, a Teradyne Robotics business, introduced a new AI Accelerator toolbox.

Isaac ROS is being used by Miso Robotics to accelerate its Flippy Fry Station, a robotic french fry maker driven by AI, and to propel improvements in food service automation efficiency and precision.

Using the Isaac Perceptor, Wheel.me is collaborating with RGo Robotics and NVIDIA to develop a production-ready AMR.

Isaac Perceptor is being used by Main Street Autonomy to expedite sensor calibration. For Isaac Perceptor, Orbbec unveiled their Perceptor Developer Kit, an unconventional AMR solution.

For better AMR navigation, LIPS Corporation has released a multi-camera perception devkit.

For ROS developers, Canonical highlighted a fully certified Ubuntu environment that provides long-term support right out of the box.

Connecting With Partners at ROSCon

Connecting With Partners at ROSCon Canonical, Ekumen, Foxglove, Intrinsic, Open Navigation, Siemens, and Teradyne Robotics are among the ROS community members and partners who will be in Denmark to provide workshops, presentations, booth demos, and sessions. Highlights consist of:

“Nav2 User Gathering” Observational meeting with Open Navigation LLC’s Steve Macenski.

“ROS in Large-Scale Factory Automation” with Carsten Braunroth from Siemens AG and Michael Gentner from BMW AG

“Incorporating AI into Workflows for Robot Manipulation” Birds of a Feather meeting with NVIDIA’s Kalyan Vadrevu

“Speeding Up Robot Learning in Simulation at Scale” Birds of a Feather session with Macenski of Open Navigation and Markus Wuensch from NVIDIA on “On Use of Nav2 Docking”

Furthermore, on Tuesday, October 22, in Odense, Denmark, Teradyne Robotics and NVIDIA will jointly organize a luncheon and evening reception.

ROSCon is organized by the Open Source Robotics Foundation (OSRF). Open Robotics, the umbrella group encompassing OSRF and all of its projects, has the support of NVIDIA.

Read more on Govindhtech.com

[machinelearningsite]

How to Create a Header File in ROS Package?

Learn the importance of header files in ROS2 development. This guide walks you through setting up and configuring header files for a simple ROS package in C++.

It is not until you work on an important project that you realize the importance of small things in programming. For me, it is the header file in C++. “Why not declare the variables and functions in the .cpp file itself?” I kept asking myself which I now realize is stupid. Now, those who have read my past blogs might have realized that I work on a project involving automated mobility. An…

[somerandomrobotguy]

Fish is not supported with ros2 so zsh for the win.

Sup nerds. Heard y'all like Linux gimmick blogs. May I interest you in a new shell?

[andmaybegayer]

Last Monday of the Week 2024-12-02

It's beginning to look a lot like December the second

Listening:

Got the soundtrack to Paradise Killer at last, which is all hits all the time. Hard to beat the first track for an introduction

Winter is better with hilariously out of place pop jazz.

I also read the artbook that came with this and it's really funny how much this game was made by like four people. Ruthlessly optimized development process by which we mean every corner that can be cut to make this a manageable workload was.

Reading:

Finished the Book of All Skies, which once again confirms that Gregan can write a good drama based on a semi-fantasy science concept.

One thing I like about Gregan is that his characters often only kind of understand the world they're in, which adds verisimilitude! I also don't know that much. If you asked me to talk about fundamental particles a lá Scale, you'd get a similar kind of "Well the last time I was really into this was six years ago, is it leptons or bosons, well, either way, the one that protons are, so yeah the strong force scales with..." kind of half assed kinda correct partially incomplete explanation.

Working through the ROS2 tutorials and reading a lot of things about robot architecture as a result. Now that I suddenly have 1.5 3D printers I don't need I'm going to be trying to hijack their control boards for Robot Shit.

Got back into The City and The City after putting it down for a while. Love an Okay Detective. Tyador is not an exceptional cop, he is definitely not a good cop, but he is, trying, so hard. Poor little meowmeow candidate.

Hard to imagine a book making a more pointed case about borders. I feel like having now half-assedly followed some Euro politics for a year I get the various weird right wing groups more thoroughly.

Watching:

Watched Miami Vice (2006) because I downloaded it at some point and was like huh sure.

This is a mixed bag. It's shot really well, it manages tone and pacing clearly and cleanly, the vibes are impeccable. The actual plot? Okay! There's gay and there's whatever these two have going on. I have not seen the TV series.

Apparently this is mostly digital? Pretty impressive for 2006, Clone Wars was only 2002, given how dark some scenes are, although I'll say we pick on DP's for lighting all black people like Moonlight these days but it's a damn side better than what we did before! Absolutely crushed skin tones in some of these scenes. A movie with a lot of very poorly lit black people.

Started and then stopped watching The Driver (1978) in Czech. It opens with a solid 15 minute car chase that works pretty well! Got distracted in the middle though.

Playing:

Very busy week here:

Got through a couple loops of Elsinore, the Hamlet time loop game where you play as Ophelia. It's okay! It struggles a bit with managing all the things you can do, and it lacks the best part of Hamlet, which is to say the text, but it's fun to mess with Hamlet and pull on weird threads. What happens if you convince Laertes to hang around. What if you don't let Polonius get killed!

There's an added story running the background that is novel to Hamlet, mostly to help make the Time Loop work out, which is okay except for the fact that it's really easy to figure out.

The game doesn't handle its information the best. Unless someone directly tells you something you often can't act on knowledge you see in the world, nor can you update other people based on things you've witnessed. If you follow an arc that makes Lady Gertrude leap from the battlements to her death, you can see this happen in person! But you have to wait for the body to be found, you can't tell the guards about this. It's a little odd.

Haven't hit an ending yet. Getting there.

Beat World of Goo 2, the 15 years later sequel to World of Goo. A noticeably harder game that is making a lot of references back to World of Goo, some fun new mechanics and generally much more complex levels that you have to make your way through. Also some very fun meta stuff that gets a little Stanley Parable Deluxe about sequels. Worth playing! But play World of Goo first, it'll make more sense, and it still holds up.

Started Cyberpunk 2077 which is... hmm. I chose Corpo because I find the concept of "Corporate ladder climber cast out on their own" to be a really compelling concept, definitely not because that's an anxiety I have. It's not like the medical program my new employer pays for costs more per month than I used to pay for a year of the one I used to have. Haha. Wouldn't that be silly. I love satire.

Anyway kind of miffed that they don't let you do the "build yourself back up" part of the roleplaying, I think it would be fun! I love roleplaying in my roleplaying games, I was looking forward to playing V as desperately holding on to the comforts of corporate life that she can no longer afford. Shame.

The gunfighting is good! One of my favourite parts of Cyberpunk the RPG is Friday Night Firefight, which is a tremendously deadly combat system. The gunplay is a little more gamey in here but you still go down fast and staying in cover and taking every advantage you can get is still important, at least as low level.

Why is there a crafting system. I saw that menu entry and recoiled physically. This is a city I exchange eurodollars for goods and services.

Making:

As mentioned, ROS2 tutorials. Many of my ESP32 projects end up reinventing message passing architectures from scratch so I figured I should just cut out the middleman. I will need to figure out a good source of embedded Linux ROS2 host, but I'm very interested in the MicroROS/ROS2 system.

ROS2 is a very *nixy approach to software, you have a lot of litle daemons and environment management and directory-heavy build system shit going on. I'm running this all in an Ubuntu Distrobox on my Arch system to keep it contained and happy which is working well.

Tools and Equipment:

You ever steam eggs? You should steam eggs. Steaming eggs is a very quick and efficient way to get boiled eggs without having to deal with a large pot of boiling water. It's much more consistent as you increase the number of eggs and you don't get any eggs bumping around in boiling water, so you can do it in very small pots or with a very large number of eggs.

A nice hardboiled egg takes about 12 minutes of steaming, and you can get a softboil out in 10 minutes. I've used bamboo steamer baskets and stainless steel vegetable steamers for this.

[taobotics]

Gemini is an open-source robotics platform for R&D, education, and personal development, with a smart design and a high price-performance ratio. Gemini combines the concepts of AGV and AMR robotics, based on a two-wheeled Differential Velocity Mechanism, and integrates more than 10 sensors such as laser radar, depth camera, ultrasonic array, microphone array, monocular array, etc., as well as rich computing power from the NVIDIA. The rich ROS/ROS2 software packages and simulation environment for beginner developers allow users to easily develop robot systems, positional guidance systems, and other systems. Users can easily develop robotic systems, positioning and navigation, audio-visual, machine learning, storage, and logistics functions.

[elmalo8291]

Elmalo, these strategic enhancements and next-step suggestions elevate the vision of Iron Spine significantly. Both options you mentioned hold tremendous potential. To help you visualize the system's complexity and layering, I can create a visual (text-based) architecture diagram that outlines the complete data flow—from raw sensor input through to AI inference and remote synchronization. This diagram would encapsulate:

Sensor Synchronization: Incorporating PTP (IEEE 1588), GPS-disciplined oscillators, and redundant sensor arrays for cross-validation.

Data Flow Layers: Starting at the sensor interface (using ROS2 or a custom hardware abstraction layer), moving through data normalization (Kalman filters / Particle Filters), and into the fusion engine (SLAM or TensorRT-based models).

Edge Inference & Communication: Leveraging frameworks like ONNX, TensorFlow Lite, or PyTorch Mobile for real-time inference at the edge, coupled with robust messaging protocols (MQTT, DDS) for inter-node communication and central control.

Power & Resilience Layers: Incorporating power management (supercapacitors, power usage monitors) and failover mechanisms (watchdog timers, redundancy protocols).

Alternatively, if you'd rather see the system in action through a concrete example, we can scope out a full pilot buildout. For instance, we could design a specialized package for a v1 Deep Sea Monitor or a v1 Mars Habitat Monitor. These would include tailored sensor selections, ruggedized enclosures for specific environmental extremes, and dedicated communication strategies adapted to underwater or extraterrestrial constraints.

Here’s a preliminary visual diagram represented in ASCII to illustrate the layered data flow:

+----------------------------------------------+ | Raw Sensor Data | | (Environmental, Motion, Optical, Acoustic, | | RF, specialized sensors) | +-------------------------+--------------------+ | v +-------------------------+--------------------+ | Sensor Interface Layer | | (ROS2 / Custom Hardware Abstraction) | +-------------------------+--------------------+ | v +-------------------------+--------------------+ | Data Normalization & Filtering | | (Kalman/Particle Filters, Confidence Index)| +-------------------------+--------------------+ | v +-------------------------+--------------------+ | Fusion Engine Layer | | (Custom SLAM, TensorRT-based models, | | Adaptive Fusion & Anomaly Detection) | +-------------------------+--------------------+ | v +-------------------------+--------------------+ | Edge Inference Layer | | (ONNX, TensorFlow Lite, PyTorch Mobile, etc.)| +-------------------------+--------------------+ | v +-------------------------+--------------------+ | Communications Layer | | (MQTT, DDS, Low-Level Mesh Protocols, etc.) | +-------------------------+--------------------+ | v +-------------------------+--------------------+ | Central Data Lake & Control | | (Cloud-based Storage, Remote Monitoring, | | Digital Twin & Dashboard Visualization) | +----------------------------------------------+

This diagram traces the journey from diverse real-world sensor inputs all the way to centralized remote control via a digital twin environment. It also highlights the injection points for synchronization, redundancy, and power management strategies.

Which Path Should We Follow Next?

Would you like to refine this visual architecture diagram further, adding any more specific elements or details?

Or, should we pivot our discussion to scoping out a full pilot buildout—say a v1 Deep Sea Package or v1 Mars Habitat Monitor—breaking down the necessary customizations, deployment plans, and field testing conditions?

Your call will shape our next steps in making Iron Spine both visionary and actionable.

[entomoblog]

Rearing of Glossina morsitans morsitans tsetse flies for the sterile insect technique: evaluating the impact of irradiation and transportation during early and late-stage pupal development on the q...

See on Scoop.it - EntomoNews

La trypanosomiase humaine africaine (THA) et la trypanosomose animale africaine (TAA) sont des maladies dévastatrices propagées par les mouches tsé-tsé (Glossina spp.), qui affectent respectivement les humains et le bétail. Les efforts actuels pour gérer ces maladies en éliminant le vecteur grâce à la technique de l'insecte stérile (TIS) nécessitent le transport de pupes de tsé-tsé irradiées au stade avancé sous réfrigération, ce qui réduirait la qualité biologique des mouches émergées. Nous avons donc évalué l'impact de l'irradiation et du transport (y compris les vibrations et les chocs) des pupes au stade précoce de développement (22 jours d'âge) à température ambiante et l'avons comparé à celui des pupes au stade avancé de développement (29 jours d'âge) sous réfrigération, la pratique actuelle pour les mouches tsé-tsé dans les programmes de TIS.

  Élevage de mouches tsé-tsé Glossina morsitans morsitans pour la technique de l'insecte stérile : évaluation de l'impact de l'irradiation et du transport au cours des premiers et derniers stades de développement nymphal sur la qualité des adultes émergents

  Rearing of Glossina morsitans morsitans tsetse flies for the sterile insect technique: evaluating the impact of irradiation and transportation during early and late-stage pupal development on the quality of emerging adults

  Caroline K. Mirieri1,2, Güler Demirbas Uzel1, Andrew G. Parker1, Jérémy Bouyer1,3, Linda De Vooght4, Vera I.D. Ros2, Monique M. van Oers2 and Adly M.M. Abd-Alla1*

  Parasite

16 October 2024

  "La qualité des mouches émergeant de ces pupes transportées a été évaluée par leurs taux d'émergence, leur propension à voler, leur capacité d'accouplement, leur taux d'insémination et leurs taux de survie (sur environ 100 jours et après des périodes plus courtes spécifiées). En général, les mouches sortant des pupes de 22 jours présentaient des valeurs significativement plus élevées (P < 0,05) pour les paramètres de qualité testés, par rapport à celles sortant des pupes de 29 jours. L'irradiation, le transport et leur combinaison ont réduit de manière significative (P < 0,05) tous les paramètres de qualité testés par rapport au témoin non traité dans le groupe des pupes de 22 jours. De plus, les vibrations ont eu un effet négatif significatif sur la qualité des mouches, quel que soit l'âge des pupes. L'irradiation et le transport des pupes à 22 jours ont donné lieu à une proportion plus élevée de mouches de bonne qualité biologique par rapport à celles de 29 jours, et peuvent donc être envisagées pour les futurs programmes TIS."

  ------

via Parasite - The Journal sur X, 03.12.2024

  "Rearing of Glossina morsitans morsitans tsetse flies for the sterile insect technique: evaluating the impact of irradiation and transportation during early and late-stage pupal development on the quality of emerging adults"

https://x.com/ParasiteJournal/status/1863864470323306580

[hals-hell]

born to artfight forced to struggle with urdf and sdf files in ros2 (i have been stuck on the same problem for the past week please i just want to simulate slam so i can move on to a physical implementation)

[machinelearningsite]

ROS Tutorial: Communication between two Computers

In this blog, I demonstrate how to establish ROS communication between machines in the same or different ROS distributions, i.e., ROS1 and ROS2.

In my previous post on Introduction to ROS, I shared how ROS is an extraordinary framework for robotics applications and is widely used in the industry of automated mobility, aka self-driving cars. Due to the demand of significant amount of computing power in such fields, it is common to use multiple computers to implement different functionalities. These machines must work in harmony and the…

[ozrobotics]

[semiconductors-and-technology]

Robot Operating System Market Strategic Forecast and Analysis 2023-2030

Scope and Overview: The Robot Operating System (ROS) has emerged as a fundamental framework for robotics software development, providing a robust and flexible platform for building and controlling robotic systems. ROS facilitates seamless integration of hardware components, sensor data processing, and autonomous navigation, driving innovation across diverse industries. The global ROS market has witnessed rapid expansion, fueled by the proliferation of robotics applications in manufacturing, healthcare, agriculture, logistics, and beyond.

Request Sample Report: https://www.snsinsider.com/sample-request/3887

Segmentation Analysis: The ROS market can be segmented based on platform type, application, end-user industry, and region. Platform types may include ROS1 and ROS2, with ROS2 gaining traction due to its enhanced features and capabilities. Applications span autonomous navigation, manipulation, perception, simulation, and more. End-user industries encompass automotive, aerospace, healthcare, consumer electronics, and defense, among others.

COVID-19 Impact Analysis: The COVID-19 pandemic has had a significant impact on the ROS market. While the initial phase witnessed disruptions in manufacturing, supply chains, and project delays due to lockdown measures and economic uncertainties, the pandemic also highlighted the importance of automation and robotics in addressing various challenges. As industries adapt to the new normal, there has been a growing emphasis on robotics solutions for contactless delivery, disinfection, remote monitoring, and telemedicine, driving demand for ROS-based applications.

Regional Outlook: The ROS market exhibits a diverse regional landscape, with North America, Europe, Asia Pacific, Latin America, and the Middle East & Africa being key regions. North America and Europe have traditionally been at the forefront of ROS adoption, owing to robust research and development infrastructure, strong presence of technology companies, and government initiatives supporting innovation. Meanwhile, the Asia Pacific region is witnessing rapid growth, fueled by expanding manufacturing activities, rising investments in automation, and increasing adoption of robotics in emerging economies.

Competitive Analysis: The ROS market is characterized by intense competition, with key players including Open Robotics, Willow Garage, Clearpath Robotics, Fetch Robotics, and ABB Ltd. These companies focus on product development, strategic partnerships, and mergers & acquisitions to strengthen their market position and expand their customer base. Additionally, the market is witnessing the emergence of startups and research institutions contributing to innovation and driving market growth.

Report Conclusion: In conclusion, the global Robot Operating System market is poised for exponential growth, driven by the increasing adoption of robotics solutions across industries and the growing demand for automation and efficiency. Despite the challenges posed by the COVID-19 pandemic, the market has demonstrated resilience and adaptability, with robotics playing a crucial role in addressing emerging needs and driving economic recovery. However, factors such as interoperability issues, data security concerns, and regulatory constraints may pose challenges to market expansion. Nonetheless, with ongoing technological advancements and collaborative efforts, the ROS market is expected to witness sustained growth, shaping the future of robotics and revolutionizing various aspects of human life and industry.

Access Full Report Details: https://www.snsinsider.com/reports/robot-operating-system-market-3887

[andmaybegayer]

hmm environment management in ros2 sucks ass. I really have to figure out how to get my distrobox to run in tmux.

I mean I guess the answer is "in a real project you write launch files"

[e-consystems]

[jhurliman]

MCAP: A recording file format for pub/sub systems, designed with robotics in mind

https://github.com/foxglove/mcap

Today marks the promotion of the MCAP file format to beta status. This is something I’ve been working on for the past several months at Foxglove, to try and standardize the robotics industry on a common recording and data interchange format for robots. The next step is to collect feedback from early adopters and continue iterating on the different language implementations before maturing to 1.0 status. Work has also begun on the MCAP ROS2 storage plugin, with the goal of replacing the default SQLite storage backend with MCAP.

If you’re working in robotics, either on a ROS-based system or non-ROS, give it a try and let me know what you think on GitHub!

[ozrobotics]

[topcrowdfundingcampaigns]

Mini Pupper 2 ROS2 Robot Kit For Dreamers - Mini Pupper 2: Open-Source, ...