Big Data Engineer

Big Data Engineer

Title: Big Data Engineer

Location: Onsite – USA

Type: Full Time

 

The Role

 

Lending Club’s Data Architecture group is responsible for the strategic architecture and deployment of the data infrastructure ecosystems. As a key member of the Big Data team you will be responsible for architecting, designing and developing major components of next generation stream and batch processing platform in Lending Club.

 

Qualifications:

 

  • Strong experience with object-oriented design, coding and testing patterns
  • Experience in architecting, building and maintaining (commercial or open source) software platforms and large-scale data infrastructures
  • Experience building big data solution using Hadoop technologies
  • 5+ years Java development experience Extensive knowledge of UNIX/Linux
  • Solid understanding of SQL and experience Hands on experience using Map/Reduce, and Hive Experience using Sqoop and Flume is a plus Understanding of MPP systems, HDFS, Map/Reduce, HBase Experience with stream processing technologies such as Storm/Spark is a plus
  • Experience with other technology such as Amazon EC2 is a plus
  • A strong team player Ability to quickly triage and troubleshoot complex problems

Share this post

Leave a Reply

Your email address will not be published. Required fields are marked *