YipitData Data Engineering Manager PySpark/Python

Job description

<p><p><b>About Us :</b><br/><br/> YipitData is the leading market research and analytics firm for the disruptive economy and most recently raised $475M from The Carlyle Group at a valuation of over $1B.<br/><br/> Every day, our proprietary technology analyzes billions of alternative data points to uncover actionable insights across sectors like software, AI, cloud, e-commerce, ridesharing, and payments.<br/><br/> Our data and research teams transform raw data into strategic intelligence, delivering accurate, timely, and deeply contextualized analysis that our customersranging from the worlds top investment funds to Fortune 500 companiesdepend on to drive high-stakes decisions.<br/><br/> From sourcing and licensing novel datasets to rigorous analysis and expert narrative framing, our teams ensure clients get not just data, but clarity and confidence.<br/><br/> We operate globally with offices in the US (NYC, Austin, Miami, Mountain View), APAC (Hong Kong, Shanghai, Beijing, Guangzhou, Singapore), and India.<br/><br/> Our award-winning, people-centric culturerecognized by Inc.<br/><br/> as a Best Workplace for three consecutive yearsemphasizes transparency, ownership, and continuous mastery.<br/><br/> <b>What Its Like to Work at YipitData :</b><br/><br/> YipitData isnt a place for coastingits a launchpad for ambitious, impact-driven professionals.<br/><br/> From day one, youll take the lead on meaningful work, accelerate your growth, and gain exposure that shapes careers.<br/><br/> <b>Why Top Talent Chooses YipitData :</b><br/><br/> Ownership That Matters : Youll lead high-impact projects with real business outcomes.<br/><br/> Rapid Growth : We compress years of learning into months.<br/><br/> Merit Over Titles : Trust and responsibility are earned through execution, not tenure.<br/><br/> Velocity with Purpose : We move fast, support each other, and aim highalways with purpose and intention.<br/><br/> If your ambition is matched by your work ethicand you're hungry for a place where growth, impact, and ownership are the normYipitData might be the opportunity youve been waiting for.<br/><br/> This is a remote opportunity based in India.<br/><br/> Standard IST working hours are permitted with the exception of 2-3 days per week, when you will join meetings with the US and LatAm team.<br/><br/> On these days, work hours will be between 2 :30 10 :30pm IST.<br/><br/> (Please note that we allow for flexibility on the following days to make up for the previous days late work schedule!).<br/><br/> <b>Why You Should Apply NOW :</b><br/><br/> Were scaling fast and need a hands-on Data Engineering Manager to join our dynamic Data Engineering team who can both lead people and shape data architecture.<br/><br/> The ideal candidate possesses 3+ years of managing data engineers and 5+ years of experience working with PySpark, Python is a must.<br/><br/> Data Bricks/ Snow Apache Iceberg/ Apache Flink/ and various orchestration tools, ETL pipelines, and data modeling.<br/><br/> As our Data Engineering Manager, you will own the data-orchestration strategy end-to-end.<br/><br/> Youll lead and mentor a team of engineers while researching, planning, and institutionalizing best practices that boost our pipeline performance, reliability, and cost-efficiency.<br/><br/> This is a hands-on leadership role for someone who thrives on deep technical challenges, enjoys rolling up their sleeves to debug or design, and can chart a clear, forward-looking roadmap for various data engineering projects.<br/><br/> <b>As Our Data Engineer Manager, You Will :</b><br/><br/>- Report directly to the Director of Data Engineering, who will provide significant, hands-on training on cutting-edge data tools and techniques.<br/><br/>- Hire, onboard, and develop a high-performing team1-on-1s, growth plans, and performance reviews.<br/><br/>- Manage a team of 3-5 Data Engineers.<br/><br/>- Serve as the teams technical north starreview PRs, pair program, and set engineering standards.<br/><br/>- Architect and evolve our data platform (batch & streaming) for scale, cost, and reliability.<br/><br/>- Own the end-to-end vision and strategic roadmap for various projects.<br/><br/>- Create documentation, architecture diagrams, and other training materials.<br/><br/>- Translate product and analytics needs into a clear data engineering roadmap and OKRs.<br/><br/> <b>You Are Likely To Succeed If :</b><br/><br/>- You hold a Bachelors or Masters degree in Computer Science, STEM, or a related technical discipline.<br/><br/>- 7+ years in data engineering (or adjacent), including 2-3+ years formally managing 1-3 engineers.<br/><br/>- Experience in PySpark, Python is a must.<br/><br/>- Experience with Data Bricks/ Snow Apache Iceberg/ Apache Flink/ Snowflake/ Databricks/Microsoft Fabrics.<br/><br/>- Proven experience designing and operating large-scale orchestration and ETL/ELT pipelines.<br/><br/>- A track record of mentoring engineers, elevating team productivity, and hiring bar-raising talent.<br/><br/>- The ability to distill complex technical topics into crisp updates for non-technical partners.<br/><br/>- You are eager to constantly learn new technologies.<br/><br/>- You are a self-starter who enjoys working with both internal and external stakeholders.<br/><br/>- You have exceptional verbal and written communication skills.<br/><br/>- Nice to have : Experience with Airflow, Docker, or equivalent.<br/><br/> <b>What We Offer :</b><br/><br/> Our compensation package includes comprehensive benefits, perks, and a competitive salary :<br/><br/> We care about your personal life, and we mean it.<br/><br/> We offer flexible work hours, flexible vacation, a generous 401K match, parental leave, team events, wellness budget, learning reimbursement, and more!<br/><br/> Your growth at YipitData is determined by the impact that you are making, not by tenure, unnecessary facetime, or office politics.<br/><br/> Everyone at YipitData is empowered to learn, self-improve, and master their skills in an environment focused on ownership, respect, and trust.<br/><br/> See more on our high-impact, high-opportunity work environment above!<br/><br/> The final offer may be determined by a number of factors, including, but not limited to, the applicant's experience, knowledge, skills, abilities, as well as internal team benchmarks.<br/><br/> We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender, gender identity or expression, or veteran status.<br/><br/> We are proud to be an equal-opportunity employer.<br/><br/> Job Applicant Privacy Notice.<br/><br/></p><br/></p> (ref:hirist.tech)

Required Skill Profession

Computer Occupations