Enterprise Big Data Solutions Architect – Spark, Scala (BB-63697)
Found in: Neuvoo CA
Description:
Big Data Solutions Architect
On behalf of our client in the Banking Sector, PROCOM is looking for a Big Data Solutions Architect.
Big Data Solutions Architect – Job Description
- The Big Data Architect will be responsible to lead big developers in implementation of big data solutions.
- This includes partnering with key roles, (project managers, architects, and business analysts) to enhance the quality of the application architecture.
- In addition, will optimize existing spark applications, mentor current spark developers, and providing best practices to implement spark applications.
- Project: Consolidated Audit Trail (CAT):
- A big data project, which tracks orders throughout their life cycle and identify the broker-dealers handling them.
- Regulatory reports are generated for the regulators to more efficiently track activity in Eligible Securities throughout the U.S. markets.
Big Data Solutions Architect – Mandatory Skills
- 10+ years of IT solution delivery, preferably playing a diverse set of roles (e.g., programmer, architect, project manager)
- 10+ years of experience building large-scale, high-performing distributed systems
- 10+ years of experience using Spark, Scala, Java, JavaScript, HTML, CSS, C++, Python and/or Perl
- 10+ years of hands-on experience with Open-Source Big Data technologies, including Hadoop, Spark, HDFS
- Detailed understanding of various database functions, Sybase, NoSQL, MongoDB
- Strong experience with knowledge of enterprise data and analytic disciplines such as enterprise Data Management, enterprise Data Warehousing, and Big Data Analytics
- Strong experience implementing big data solutions with Scala in a Spark-Yarn Architecture
- Solid background and knowledge of distributed computing, SOA architecture and data storage/partitioning best practices
- Strong experience implementing software and/or solutions, in terms of both tools and systems administration, in the enterprise Linux/Unix, OpenStack or Microsoft environment
- Strong understanding of the Java ecosystem and enterprise offerings, including debugging and profiling tools (jconsole), logging and monitoring tools (log4j, JMX), and security offerings (Kerberos/SPNEGO)
- Proven experience with Software Development Life Cycles, especially as it applies to leading architecture of a large complex data-centric programs and projects, from business strategies and requirements data design, data sourcing, data transformation, analytics design, development, testing, and implementation
- Strong understanding of Big Data analysis and machine learning concepts
Big Data Solutions Architect - Assignment Start Date
ASAP – 12 months to start
Big Data Solutions Architect - Assignment Location
Toronto, ON – Work Remotely
calendar_today3 days ago
report