Senior Big Data Engineer

We are looking for a Senior Big Data Engineer to team up with Sigma Software and apply the best engineering practices in daily work. We expect our ideal candidate to be flexible and motivated to work in a fast-paced environment.

Our client is a big EHR provider on the market of California, expanding also outside of it. The system provides its services for hundreds of clients that process data in different formats. 

The application provides ample capabilities for data analysis in the area of Healthcare. It allows taking data from different sources and easily processing it to enable rapid decision making at any business level.

Your responsibilities will include:

  • Working on POC
  • Leading a team of developers during the post-POC phase
  • Designing, reviewing, implementing, testing, and optimizing ETL (batch and real-time) processes
  • Designing and developing Big Data applications while migrating to the new technology stack
  • Troubleshooting data and/or system issues
  • Providing technical knowledge sharing with teammates and the customer

What we expect from you:

  • At least 3 years of development experience with Python, HQL, SQL
  • Strong experience with Zeppelin, Hive/Tez, Spark Core/SQL, and its Streaming from Kafka
  • Strong knowledge of the Hadoop Ecosystem
  • Experience in Data Warehousing/RDBMS technologies and back-end reporting systems
  • Experience with ETL, data parsing is necessary
  • Experience of working with different data types (Excel, EDI, CSV, etc.)
  • Strong scripting skills to perform data/file manipulation
  • Experience with automated testing practices
  • Low-level performance optimization experience
  • Good knowledge of MS Azure (preferred) or AWS-related service
  • At least Intermediate level of English

Would be a plus:

  • Experience with microservices development

You are welcome to join our team!
Please send your CV to: team@sigma.software