Enterprise Big Data Solutions Architect – Spark, Scala (BB-63697)

Found in: Neuvoo CA


Big Data Solutions Architect

On behalf of our client in the Banking Sector, PROCOM is looking for a Big Data Solutions Architect.

Big Data Solutions Architect – Job Description

  • The Big Data Architect will be responsible to lead big developers in implementation of big data solutions.
  • This includes partnering with key roles, (project managers, architects, and business analysts) to enhance the quality of the application architecture.
  • In addition, will optimize existing spark applications, mentor current spark developers, and providing best practices to implement spark applications.
  • Project: Consolidated Audit Trail (CAT):
  • A big data project, which tracks orders throughout their life cycle and identify the broker-dealers handling them.
  • Regulatory reports are generated for the regulators to more efficiently track activity in Eligible Securities throughout the U.S. markets.

Big Data Solutions Architect – Mandatory Skills

  • 10+ years of IT solution delivery, preferably playing a diverse set of roles (e.g., programmer, architect, project manager)
  • 10+ years of experience building large-scale, high-performing distributed systems
  • 10+ years of experience using Spark, Scala, Java, JavaScript, HTML, CSS, C++, Python and/or Perl
  • 10+ years of hands-on experience with Open-Source Big Data technologies, including Hadoop, Spark, HDFS
  • Detailed understanding of various database functions, Sybase, NoSQL, MongoDB
  • Strong experience with knowledge of enterprise data and analytic disciplines such as enterprise Data Management, enterprise Data Warehousing, and Big Data Analytics
  • Strong experience implementing big data solutions with Scala in a Spark-Yarn Architecture
  • Solid background and knowledge of distributed computing, SOA architecture and data storage/partitioning best practices
  • Strong experience implementing software and/or solutions, in terms of both tools and systems administration, in the enterprise Linux/Unix, OpenStack or Microsoft environment
  • Strong understanding of the Java ecosystem and enterprise offerings, including debugging and profiling tools (jconsole), logging and monitoring tools (log4j, JMX), and security offerings (Kerberos/SPNEGO)
  • Proven experience with Software Development Life Cycles, especially as it applies to leading architecture of a large complex data-centric programs and projects, from business strategies and requirements data design, data sourcing, data transformation, analytics design, development, testing, and implementation
  • Strong understanding of Big Data analysis and machine learning concepts

Big Data Solutions Architect - Assignment Start Date

ASAP – 12 months to start

Big Data Solutions Architect - Assignment Location

Toronto, ON – Work Remotely

calendar_today3 days ago


location_on Toronto, Canada

work Procom

I expressly authorise the Terms and Conditions

Similar jobs