| |
![]() |
 |
![]() |
|
| |
| |
|
|
| |
Project Tungsten: Bringing Spark Closer to Bare Metal |
|
| |
|
|
| |
Tuesday, May 05, 2015 |
|
| |
Project Tungsten will be the largest change to Spark’s execution engine since the project’s inception. It focuses on substantially improving the efficiency of memory and CPU for Spark applications, to push performance closer to the limits of modern hardware. This effort includes three initiatives:
1.Memory Management and Binary Processing: leveraging application semantics to manage memory explicitly and eliminate the overhead of JVM object model and garbage collection
2.Cache-aware computation: algorithms and data structures to exploit memory hierarchy
3.Code generation: using code generation to exploit modern compilers and CPUs |
|
| |
|
|
|
|
|
