Advanced Micro Devices (AMD) relies on manufacturing test data to ensure product quality and perform engineering analysis in order to improve upon its world-class product designs. The company decided to migrate from a relational database management system (RDBMS) to an Apache Hadoop-powered Cloudera system that can process and store more detailed and historical data at low cost.
Advanced Micro Devices (AMD) relies on manufacturing test data to ensure product quality and perform engineering analysis in order to improve upon its world-class product designs. The company decided to migrate from a relational database management system (RDBMS) to an Apache Hadoop-powered Cloudera system that can process and store more detailed and historical data at low cost. The result:
- Up to 40X faster query performance over larger volumes of data
- Storing more than 90% of available data elements over 1.5-plus years of history
- In an environment that requires less support and enables cost savings to the company
- Using fewer integration tools and steps
The semiconductor manufacturer deployed the Dell Cloudera Solution for Apache Hadoop as its engineering data warehouse (EngDW), which collects data throughout the manufacturing process. Hundreds of millions of new digital and parametric test readings are loaded to the cluster every day.
Hadoop technologies have allowed us to develop a solution that empowers our engineers to access larger product data sets in drastically reduced times.
Jonathan Jarvis, Product Development Engineer, AMD
Impact: Better, Faster Analytics Improve Business Visibility
AMD's decision to move from an RDBMS to a Hadoop platform that uses Cloudera on Dell servers powered by AMD Opteron processors has resulted in orders of magnitude performance improvement, in terms of both data loads and analytics.
- 99% of all queries execute in 15 minutes or less, with a median execution time of just 23 seconds.
- Queries on hundreds of thousands of units execute two orders of magnitude faster than before.
- Data reloads at a rate of three months per day, whereas it used to take a full day to reload 1.5 days’ data—that’s 60X faster.
Now that AMD engineers can access greater amounts of test data in higher detail and at faster speeds—applying data insights, debugging, and making continuous improvements —work is completed to ensure that the company delivers world-class products that enable today and inspire tomorrow.
Impact: Greater Simplicity, Lower Cost
AMD has not only recognized performance benefits through its Hadoop-based platform, but has also significantly reduced the total cost of ownership (TCO) through
- Lower vendor support costs for relational database management software
- Less vendor support for data integration tools and software
- Fewer steps and tools needed for data integration
- Less vendor support for high-end storage arrays (external SAN storage)
- Smaller IT support staff needed for end-to-end management
By migrating its engineering data warehouse to a big data platform powered by Cloudera, AMD’s product testing workflow benefits from analytics that are faster, more comprehensive, and more flexible, in an environment that delivers significant cost savings and greater operational efficiency.
- Capturing more than 30% of available data elements throughout manufacturing process
- Engineering data warehouse on Dell Cloudera Solution
- Query response times reduced by 75% to 98% over larger volumes of data
- Data reloads 60X faster
- Capturing 90%+ of available data elements, vs. 30% before
- Ability to load & keep 1.5+ years’ historical data vs. 3-4 months before
- Lower TCO