Skip to main content

Compute

Discuss hardware, software, and computing resources related to your projects.

  • 6 Topics
  • 0 Replies
6 Topics
janetteguzman
HP Employee
janetteguzmanHP Employee
published in Compute
AI Edge Computing for Intelligent Traffic Monitoring

A recent paper titled “Edge computing and AI-driven intelligent traffic monitoring and optimization” explores how edge computing can be used to decentralize AI compute by processing data near IoT devices and vehicles to reduce latency and cloud dependency. The paper finds that edge computing using SLAM technology adequately places compute and storage closer to data sources and end users to enable faster data processing and response times of AI workloads for real-time traffic management, autonomous driving, and V2X communication.  Top five take-aways:1. Bring compute close to the data source: Edge computing places processing power closer to data sources (e.g., IoT devices, vehicles), enabling real-time data analysis and response. This reduces latency, enhances reliability, and alleviates bandwidth constraints, particularly crucial for traffic management and autonomous driving during peak periods.2. Decentralize to improve system efficiency and economy of resource you own:By decentralizi

250
janetteguzman
HP Employee
jrgosalvez
jrgosalvezCommunity Manager
published in Compute
Fine-tuning Enormous LLMs on Z by HP Workstations

Robert Luciani with The AI Framework discovered that using low-rank adaptation and quantization it is possible to fine-tune LLMs on Z by HP workstations. To validate this, Robert used Hugging Face’s State-of-the-art Parameter-Efficient Fine-Tuning (PEFT) method. 

1070
jrgosalvez
Sothan
SothanCommunity Manager
published in Compute
Revolutionizing Productivity and Development with AI Workstations

A recent survey showed that 86% of CEOs saw AI as a key part of business operations. Its rapid rise in customer-facing roles and its ability to enhance efficiency across various industries made it a top priority for many leaders. While there are plenty of exciting opportunities, there were also challenges to navigate when it came to implementing these new strategies.In a recent fireside chat, Sama Bali, Senior Product Marketing Manager at NVIDIA, chatted with Alex Klug, Senior Manager of Data Science & AI Product Management at HP. They talked about the current state of generative AI in businesses, the essential role of workstations for data science teams, and took a closer look at Z by HP’s software solutions powered by NVIDIA graphics. You can catch the full discussion: https://www.brighttalk.com/webcast/20544/628829

740
Sothan
jrgosalvez
jrgosalvezCommunity Manager
posted in Compute
Hybrid Memory to Boost GPU Performance

Stanford University research team explores gain cell memory technology to address the limitations of current SRAM and DRAM memory in GPUs. By combining features of both SRAM and DRAM, the goal is to speed up data access and reduce power consumption.Top Three Takeaways:Gain Cell Memory: hybrid gain cells combine the speed of SRAM with the capacity of DRAM, to overcome the memory wall problem in GPUs by reducing data transfer delays. Innovative Materials: combining different materials for transistors (ALD ITO FET and Si PMOS), the hybrid gain cells provide faster data access, non-destructive reads, and significantly longer data retention compared than traditional DRAM. Potential for SoC Applications: can serve as a drop-in replacement for SRAM, offering higher capacity at lower fabrication costs, making it attractive for SoC manufacturers in datacenter GPUs, CPUs, and embedded systems.Check out Chris Mellor article on Blocks & Files: “Stanford team proposes hybrid gain cell memory to

440
jrgosalvez
TomSadlerHPAI
Explorer
TomSadlerHPAIExplorer
posted in Compute
The Hidden Costs Of Cloud And Where To Find Overspending

The Hidden Costs Of Cloud And Where To Find Overspending (forbes.com) I know this Article is leaning towards FinOps, but that principles and strategies are on similar trajectories for us working in AI and Data Science.  Finding the right mix of computing is a fine art and takes time and understanding to find the perfect mix for you.  Cloud Spending: Gartner predicts that enterprise IT spending on public cloud computing will exceed 51% by 20251. However, 30% of cloud spend is currently wastedOptimization Strategies: Key strategies include right-sizing infrastructure, managing workload placement, leveraging multi-cloud environments, and automating the deletion of idle instances.What are your thoughts on a Hybrid modality? 

670
TomSadlerHPAI
Explorer
jrgosalvez
jrgosalvezCommunity Manager
posted in Compute
New Compute Throughput Tip - Increase Batch Sizes, Tune

New computers with powerful GPUs can bottleneck at the CPU if code is not modified to increase batch sizes sent to the GPUs. To improve processing performance of your system, update and tune hyperparameters in your code to deliver larger batch payloads to your GPU.Tuning to balance overfitting and underfitting, we found a 5x performance on model training, giving our team more time to do experiments. Adil Lheureux published a good read on the topic called “How to maximize GPU utilization by finding the right batch size” that you should check out. 

210
jrgosalvez
Terms & ConditionsCookie settings