<p><p><b>About organisation : </b><br/><br/>- Boutique consultancy ?
Presence : India, Canada, USA, Singapore, Dubai.
5 years of sustained growth.<br/><br/>- 100% practitioner led company, with a strong footprint in real-time data & ai platforms.
Strong history of open-source contributions and thought leadership<br/><br/>- Award winning Confl uent delivery partner.
Partnerships with AerospikeDB, DBRX, Clickhouse, Temporal and several other technologies</p><p><b>What youll do</b><br/><br/>- Work as a lead engineer on customer projects, involving Confluent, Databricks, Clickhouse, Aerospike and a host of other data platform and infrastructure technologies<br/><br/>- Put on a product hat, to help evolve a data platform suitable for marketing data in a complex landscape with multi-national conglomerates.
Challenges intersecting data quality, lineage, real-time analytics and more<br/><br/>- Work on building data pipelines, using Kafka, Flink, Spark and other technologies<br/><br/>- Mentor junior engineers on the DBRX path<br/><br/>- Participate in POCs, pre-sales and consulting assignments at you must bring :</b></p><br/>- High degree of competence in Python (OR) Java/Scala stack, SQL and ETL/ELT (minimum).
Deeper conceptual experience outside the notebook.<br/><br/>- Solid concepts and understanding of Databricks stack, along with Spark, Delta Lake, Apache Iceberg and the broad spectrum of big data storage and processing technologies<br/><br/>- Deep understanding of building enterprise grade data lakehouses (medallion architecture), but a POV on pata quality, lineage and catalogue<br/><br/>- Stretch : Exposure to Docker, Kubernetes and infrastructure on the cloud.
Be able to deploy and operate a stack to a reasonable extent<br/><br/>- Stretch : ML Engineering and<br/><br/>- Stretch : Exposure to the Apache Kafka / Confluent, Flink and stream processing</p><br/></p> (ref:hirist.tech)