Scala Developers – (5- Positions)
Developers 5+ years’ experience in
- Using Scala to write Spark simple aggregation code, such as: an input record, take N dimensions, N indicators, Records convergence through the reduceByKey
- Spark Code Debugging using DPA logs
- Capability to analyze threshold table to do index filtering judgment, Capability to Associate with single or multiple dimension tables ,on the basis of simple aggregation process
- Capability to debug non functional Spark issues eg – memory overflow, timeout problems, Spark cluster configuration issues, API usage issues, Driver Problems, Executor Problems
- Optimize Spark Performance