#OracleRovingEdgeDevice

[govindhtech]

New Oracle Roving Edge Device Revolutionizes AI At The Edge

Oracle’s second-generation Roving Edge Device (RED), the newest product in the company’s e Edge Cloud line, offers exceptional processing power, smooth connection, and integrated security at network edges and in remote areas. Numerous workloads, including corporate applications, AI, and certain OCI services, may be operated at the edge with Roving Edge Device(RED) because to its easy deployment, great price-performance, and better security, which includes the option to run isolated or air-gapped.

What is Oracle Roving Edge Device?

OCI cloud computing and storage are made possible at network edges and in remote areas via the Oracle Roving Edge Device (RED), a portable hardware platform with cloud-integrated services.

The second version of the Roving Edge Device builds upon a strong foundation created to satisfy the requirements of security applications. It not only improves basic capabilities but also adds customized configurations to satisfy business needs in a range of sectors.Image Credit To Intel

Introducing the second generation Oracle RED

With more OCPUs, RAM, storage, and better GPU performance, the second iteration of the Oracle Roving Edge Device offers significant improvements over the first generation.Image Credit To Intel

RED is available in three configurations to suit diverse business

Where can you deploy Oracle Roving Edge Device?

In your data center or at the edge, RED offers the same OCI development and deployment methods, selectable OCI services, and CPU and GPU forms. This drives development in many industries and technical advancement in today’s fast-paced commercial environment. Due to its unrivaled processing power, smooth connectivity, and steadfast security, the Roving Edge Device is ideal for cutting-edge applications that need speed, dependability, and efficiency.

Improvements in performance with the second-generation RED

Milliseconds matter in the fast-paced world of artificial intelligence. Imagine a future in which your network’s borders are infinite and its edge gets exponentially more intelligent. Customers now have more deployment options with to Oracle Roving Edge Device 2nd Generation (RED), which has a new GPU-optimized configuration with compute- and storage-optimized configuration.

Customers gain from low-latency processing nearer the point of data production and ingestion by utilizing the Intel Xeon 8480+ processor’s capability at the edge, which leads to more timely insights into their data. Oracle and Intel collaborated to perform a number of benchmarks over the first-generation RED in order to test this capability.

It used only Intel Xeon processors to run the Llama 2-7B, Yolov10 model, and Resnet50 convolutional neural network (CNN) for the testing. The Intel Xeon 6230T-based first-generation Roving Edge Device is compared to the Intel Xeon 8480+-based second-generation using the following benchmarks:

Deploying Llama2-7B on RED

An autoregressive, transformer architecture serves as the foundation for the Llama 2 family of pre-trained and optimized text generation models. Three models with seven billion, thirteen billion, and seventy billion parameters are included with Llama 2. Oracle benchmarked the Llama 2 7 billion parameter model for this simulation.

Using the Llama 2-7B model, the second-generation Roving Edge Device may achieve response rates up to 13.6 times faster than RED Gen 1, allowing for lightning-fast performance for edge-based large language model (LLM) inferencing. Enhancement of Throughput Intel Xeon 8480+ Processor.

Using the Llama2-7B paradigm, the RED Gen 2 may achieve up to 12.4 times higher throughput, greatly increasing the edge’s capacity for processing LLM data.

YOLO v10

Real-time object identification and precise, low-latency object category and location prediction in pictures were the goals of the YOLO family of models. Oracle compared using the YOLO v10 model on the two versions of Roving Edge Device in this set of benchmarks.

Up to 60% more performance may be achieved by the new RED generation than by the old one. YOLO v10 increased throughput by 67%.

ResNet-50

A convolutional neural network (CNN) architecture called ResNet-50 is a member of the Residual Networks (ResNet) family, a group of models created to tackle the difficulties involved in deep neural network training. Renowned for its depth and effectiveness in image classification tasks, ResNet-50 was created by researchers at Microsoft Research Asia. There are several levels of ResNet topologies, including ResNet-18 and ResNet-32, with ResNet-50 being a mid-sized version.

Using the ResNet 50 CNN, the second generation achieves a response rate that is up to three times higher than the first.

Why deploy with Oracle Roving Edge Device? 

Oracle Roving Edge Device is the best option if you need to deploy application workloads at the edge and need a scalable, secure, and adaptable platform with the advantages of cloud computing and cost-effectiveness. Built to execute time-sensitive, mission-critical applications at the edge in both connected and unconnected areas, it is a powerful cloud-integrated service.

Getting Started

Oracle Roving Edge Device is the perfect infrastructure for anybody seeking a high-security, low-latency data processing and scalable environment at the edge because of its affordable, adaptable configurations and capacity to serve computing, storage, and GPU-intensive applications.

Read more on govindhtech.com

[govindhtech]

Oracle Roving Edge Device(RED) Utilizing Intel To Improve AI

Boosting AI at the Periphery: Oracle Roving Edge Device(RED) Using Intel

Oracle Roving Edge Device

In the rapidly evolving digital terrain of today, enterprises are progressively shifting away from centralized public clouds and toward distributed cloud models that include hybrid, multi-cloud, and edge solutions. This change satisfies crucial requirements for data residency, latency, and security in addition to providing flexibility and scalability.

- Advertisement -

With 78 locations worldwide, Oracle Cloud Infrastructure (OCI), the cloud provider with the quickest pace of growth, is making a major advancement with the release of the second iteration of the Oracle Roving Edge Device. With this most recent addition, Oracle’s portfolio of distributed clouds now offers remarkable processing power, cutting-edge connectivity, and improved security right to the edge even in situations that are unconnected.

The Oracle Roving Edge Device(RED) second version streamlines deployment while offering the cost-efficiencies of cloud technology by enabling enterprises to operate corporate apps, AI models, and specific OCI services directly at the edge. This changes how firms may use edge computing and makes it a vital tool for sectors needing instantaneous, local data processing with strict security constraints.

What Is Special About Oracle Roving Edge Device?

The Oracle Roving Edge Device was first designed to satisfy the tactical requirements of the US Department of Defense, but it has since expanded to fulfill corporate needs in a variety of industries. Building upon this solid basis, Oracle Roving Edge Device has three configurable configurations, Base and Storage-Optimized versions with Intel CPUs among them:

Base Configuration: This version is perfect for a variety of applications needing strong processing since it is powered by an Intel Xeon 8480+ processor (56 cores) and 512GB DDR5 memory.

- Advertisement -

Storage Optimized: With eight 15.38TB NVMe SSDs, this configuration is ideal for data-intensive applications that need large amounts of storage and quick processing.

Using the Llama2-7B model, the Base second generation RED configuration with 4th gen Intel Xeon 8480+ may provide up to 13.6x reduced latency than the original Oracle Roving Edge Device with Intel Xeon 6230T.

The Use of Strategic Edges

RED is a commercial enabler as well as a technical breakthrough. Whether using it at the edge or in a conventional data center, enterprises may deploy the same OCI services, development processes, and CPU/GPU capabilities. Because of this flexibility, businesses in sectors including industrial, government, telecom, retail, and AI/ML may use mission-critical apps, secure networking, real-time analytics, and AI/ML anywhere, even in remote places.

For instance, RED may provide real-time information in crucial contexts like military or healthcare, or it might improve operational efficiency via predictive maintenance in distant industrial locations.

Why It Is Worth Considering

For companies that want local data processing with the dependability and affordability of the cloud, Oracle RED, which is equipped with Intel processors, provides a safe, scalable, and high-performance platform. RED offers an unmatched solution if your company has workloads that are mission-critical and need edge deployment in real-time.

With the speed, security, and flexibility of the second-generation Oracle Roving Edge Device, you can take your operations to the next level and empower your organization with Intel and Oracle.

Cutting-Edge Infrastructure

Roving Edge Infrastructure from Oracle Cloud Infrastructure (OCI) speeds up the deployment of cloud workloads outside of data centers. Ruggedized devices provide quicker processing near the data source and faster insights into the data by delivering cloud computing and storage services at the edge of networks and in remote areas.

Using the same portal and tenancy tools as oracle public regions, existing OCI compute images and object storage may be synced to Oracle Roving Edge device.

Examine Oracle’s Cutting-Edge Infrastructure

Cloud functionality in isolated settings

Expand the use of current cloud environments: Customers in the public and private sectors are able to implement OCI services outside of OCI Dedicated Regions and Oracle Public Cloud regions.

Utilize apps at the edge of the network: Rather of depending on distant services that need several network hops, field operations teams may get very low latency locally for cloud applications that are sensitive to delays.

Execute disjointed tasks: Even when fully unconnected, faraway sites may benefit from Oracle Cloud Infrastructure capabilities thanks to small, portable server nodes.

Use cases for Oracle Roving Edge Infrastructure

Quick field data collecting and processing: Utilize the potent computational capabilities of Roving Edge Infrastructure devices to absorb and handle massive volumes of streaming data from sensors situated in far-off places.

Deploying applications to distant locations: Facilitate the smooth implementation of applications for establishments including embassies and consulates, government offices, military outposts, and distant educational institutions.

Create, test, and deploy at the edge of the cloud: Create, implement, and manage all cloud-based apps and data, extending their reach to the edge as required, all managed via a unified pane of glass.

ML and AI on the periphery: For quicker processing of AI and ML applications, attach VPU/TPU accelerators or use built-in GPUs to avoid depending on network access to Oracle Cloud Infrastructure.

Read more on govindhtech.com