Big Data & Cloud Solutions Architect

OpenSistemas

We are looking for an experienced Senior Big Data Engineer to help us build big date solutions over Google Cloud, Amazon and Microsoft Azure. This is an ideal position for a Big Data Engineer that will manage collecting, storing, processing, and analyzing of huge sets of data in collaboration with our Data Scientist. You need to be Self-directed, results-oriented team-player that has the drive to make a difference in a high-energy and open source environment. Experience needed:

  • Distributed computing principles
  • Proficiency in Python required. Experience with Scala is a big plus.
  • Spark, MapReduce, HDFS
  • Building stream-processing systems, using solutions such as Spark-Streaming, Kafka
  • NoSQL databases: MongoDB, Cassandra.
  • Knowledge of various ETL techniques and frameworks, such as Flume, Kettle ( Pentaho PDI )
  • Experience with Agile principles and practices such as Continuous Integration
Enviar solicitud