Job Description

Data Engineer

Our client is a small, established technology firm whose product is leading edge in the area’s of data analytics, marketing and behavioral analysis. This is a group of talented and passionate tech professionals – Work environment is superb, beautiful agile work space, all the perks – food, fun and more – SMART folks where you will be counted on to deliver yet will likely learn as well –

Client is looking for knowledgeable and talented Data Engineers to join their team… Candidate will join the client’s Data Engineering and Business Analytics team to contribute towards collecting, storing, processing, and analyzing huge sets of data.

Responsibilities and Duties

  • Gather, profile, analyze and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.)
  • Design and develop code to load and transform the source data from various formats (like relational, unstructured, semi-structured) into a form suitable for analysis
  • Identify reporting requirements and translate those into supporting data structures including dimensional (star-schema) marts, aggregate and normalized tables
  • Conduct ETL, SQL and DB performance tuning, troubleshooting and capacity estimation to meet SLA’s and ensure highest data quality standards
  • Support business decisions with ad hoc analysis as needed

Qualifications and Skills

  • Bachelor's degree in related area (Computer Science, Information Systems, Engineering, Statistics) or an equivalent combination of education and experience
  • 5+ years of design, development, testing and support for successfully designing and implementing big data-centric applications and programs
  • Extremely proficient in at least one of the programming language, ideally in Java or python but JavaScript, Scala, R is acceptable too
  • Good understanding of Lambda Architecture
  • Proficient in using one of the big data tools such as Pig, Hive, Spark SQL, Impala, Presto, Sqoop, Oozie, etc..
  • Proficient in at least one of the commonly used data integration tool like Microsoft’s SSIS, Informatica, SnapLogic, PL/SQL, or any other open source tool
  • Experience working with streaming data ingestion services like Amazon Kinesis, Firehose, Kafka, Flume, etc
  • Powerful hands-on SQL based data extraction skills to manipulate data from common relational database systems (Oracle, Postgres, SQL Server), distributed systems (Amazon Redshift, Teradata), NoSQL databases (Mongo DB)
  • Experience working on big data technologies like Hadoop v2.0, Spark, Amazon EMR, MapReduce, Cloudera or Hortonworks
  • Experience with Business Intelligence and reporting tools (preferably Tableau, R, SSRS)
  • Understanding and experience in 3NF & dimensional (STAR schema) approaches for data warehouse environment
  • Understanding of various compression techniques and storage formats
  • Familiar with the workings of network, servers, AWS infrastructure & cloud services
  • Familiar in data mining, machine learning, natural language processing or Statistical analysis
  • Demonstrated experience translating business and technical requirements into data models

 

This is the ideal place for that passionate yet accomplished go getter – Generous salary, unlimited vacation, Stock, Bonus, more…

 

 

 

Application Instructions

Please click on the link below to apply for this position. A new window will open and direct you to apply at our corporate careers page. We look forward to hearing from you!

Apply Online