Skip to main content

Compute

Discuss hardware, software, and computing resources related to your projects.

  • 5 Topics
  • 0 Replies
5 Topics
jrgosalvez
jrgosalvezCommunity Manager
published in Compute
Fine-tuning Enormous LLMs on Z by HP Workstations

Robert Luciani with The AI Framework discovered that using low-rank adaptation and quantization it is possible to fine-tune LLMs on Z by HP workstations. To validate this, Robert used Hugging Face’s State-of-the-art Parameter-Efficient Fine-Tuning (PEFT) method. 

490
jrgosalvez
13 days ago
Sothan
SothanCommunity Manager
published in Compute
Revolutionizing Productivity and Development with AI Workstations

A recent survey showed that 86% of CEOs saw AI as a key part of business operations. Its rapid rise in customer-facing roles and its ability to enhance efficiency across various industries made it a top priority for many leaders. While there are plenty of exciting opportunities, there were also challenges to navigate when it came to implementing these new strategies.In a recent fireside chat, Sama Bali, Senior Product Marketing Manager at NVIDIA, chatted with Alex Klug, Senior Manager of Data Science & AI Product Management at HP. They talked about the current state of generative AI in businesses, the essential role of workstations for data science teams, and took a closer look at Z by HP’s software solutions powered by NVIDIA graphics. You can catch the full discussion: https://www.brighttalk.com/webcast/20544/628829

130
Sothan
21 days ago
jrgosalvez
jrgosalvezCommunity Manager
posted in Compute
Hybrid Memory to Boost GPU Performance

Stanford University research team explores gain cell memory technology to address the limitations of current SRAM and DRAM memory in GPUs. By combining features of both SRAM and DRAM, the goal is to speed up data access and reduce power consumption.Top Three Takeaways:Gain Cell Memory: hybrid gain cells combine the speed of SRAM with the capacity of DRAM, to overcome the memory wall problem in GPUs by reducing data transfer delays. Innovative Materials: combining different materials for transistors (ALD ITO FET and Si PMOS), the hybrid gain cells provide faster data access, non-destructive reads, and significantly longer data retention compared than traditional DRAM. Potential for SoC Applications: can serve as a drop-in replacement for SRAM, offering higher capacity at lower fabrication costs, making it attractive for SoC manufacturers in datacenter GPUs, CPUs, and embedded systems.Check out Chris Mellor article on Blocks & Files: “Stanford team proposes hybrid gain cell memory to

140
jrgosalvez
1 month ago
TomSadlerHPAI
Explorer
TomSadlerHPAIExplorer
posted in Compute
The Hidden Costs Of Cloud And Where To Find Overspending

The Hidden Costs Of Cloud And Where To Find Overspending (forbes.com) I know this Article is leaning towards FinOps, but that principles and strategies are on similar trajectories for us working in AI and Data Science.  Finding the right mix of computing is a fine art and takes time and understanding to find the perfect mix for you.  Cloud Spending: Gartner predicts that enterprise IT spending on public cloud computing will exceed 51% by 20251. However, 30% of cloud spend is currently wastedOptimization Strategies: Key strategies include right-sizing infrastructure, managing workload placement, leveraging multi-cloud environments, and automating the deletion of idle instances.What are your thoughts on a Hybrid modality? 

400
TomSadlerHPAI
Explorer
4 months ago
jrgosalvez
jrgosalvezCommunity Manager
posted in Compute
New Compute Throughput Tip - Increase Batch Sizes, Tune

New computers with powerful GPUs can bottleneck at the CPU if code is not modified to increase batch sizes sent to the GPUs. To improve processing performance of your system, update and tune hyperparameters in your code to deliver larger batch payloads to your GPU.Tuning to balance overfitting and underfitting, we found a 5x performance on model training, giving our team more time to do experiments. Adil Lheureux published a good read on the topic called “How to maximize GPU utilization by finding the right batch size” that you should check out. 

90
jrgosalvez
10 months ago
Terms & ConditionsCookie settings