Database/Software Engineer (Big Data)

We’re hiring a Database/Software Engineer to design, implement and test robust pipelines of ever growing data. Data processing, machine learning and algorithms are the heart and core of our company.

You will join a startup company with focus on data ingestion, data validation, data matching and analytics. You will lead database infrastructure and building of platform (data ingestion and workflow). You will set up and create tooling to ingest large number of external/market data feeds into an internal database. You will be responsible for backups, recovery and replication of database infrastructure. Your main goal is to work towards one unified goal to keep our data secure, up to date and accessible for times to come.

Our goal is to combine the latest open source technologies together with traditional enterprise software products.

What you will be working on:
• Building our database infrastructure in the cloud across a constellation of microservices.
• Create tooling to automate database infrastructure deployment on any environment.
• Design and implement data ingestion and model generation.
• Integrate new data sources from API and non-API sources.
• Creative use of the market data, as well as integration of new types of incoming data
• Scale the infrastructure and models with ever-growing datasets.
• Develop advanced analytics and data workflow platform
• Building, maintaining, testing and evaluation of data solution
• Integrate enterprise data matching software tool into data model
• You will be responsible for backups, recovery and replication of database infrastructure.

Essential Technical Skills:
• Experience designing and building data ingestion pipelines
• Experience with integration of data from multiple sources
• Running production databases where consistency is paramount.
• Production experience with data management, storage and pipeline.
• Production experience with cloud environments, Hadoop and Spark.
• Hands-on experience provisioning and developing solutions in the AWS Cloud infrastructure
• Requires thorough understanding of the Hadoop security best practices and has experience implementing data encryption controls.
• Design and implement research and production pipelines for data ingestion and model generation.

Working from home. Part-time. Ideal as a second job.