Cutshort logo
Thoughtworks logo
Lead Consultant: Data Engineer
Lead Consultant: Data Engineer
Thoughtworks's logo

Lead Consultant: Data Engineer

Vidyashree Kulkarni's profile picture
Posted by Vidyashree Kulkarni
9 - 15 yrs
Best in industry
Remote only
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
skill iconScala
Data Structures
Data modeling
Data security
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

Job responsibilities
  • You will partner with teammates to create complex data processing pipelines in order to solve our clients' most complex challenges
  • You will collaborate with Data Scientists in order to design scalable implementations of their models
  • You will pair to write clean and iterative code based on TDD
  • Leverage various continuous delivery practices to deploy, support and operate data pipelines
  • Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
  • Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
  • Create data models and speak to the tradeoffs of different modeling approaches
  • Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
  • Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications

Technical skills

  • You have a good understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
  • You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
  • Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
  • You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
  • Working with data excites you: you can build and operate data pipelines, and maintain data storage, all within distributed systems
  • You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
  • Professional skills
  • You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
  • An interest in coaching, sharing your experience and knowledge with teammates
  • You enjoy influencing others and always advocate for technical excellence while being open to change when needed
  • Presence in the external tech community: you willingly share your expertise with others via speaking engagements, contributions to open source, blogs and more
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Software Media Company
Software Media Company
Agency job
via Jobdost by Sathish Kumar
Mumbai
1 - 3 yrs
₹2L - ₹5L / yr
skill iconPython
skill iconDjango
API

Required experience:

  • Minimum 1 year of experience in Web & Backend Development using Python

Overview

We are looking for Python developers with a strong understanding of object orientation and experience in web and backend development. Experience with Analytical algorithms and mathematical calculations using libraries such as Numpy and Pandas are a must. Experience in some form of Machine Learning. We require candidates who have working experience using Django Framework

 

Key Skills required (Items in Bold are mandatory keywords) :

  1. Proficiency in Python 3.x based web and backend development
  2. Solid understanding of Python concepts
  3. Experience with some form of Machine Learning (ML)
  4. Experience in using libraries such as Numpy and Pandas
  5. Some form of experience with NLP and Deep Learning using any of Pytorch, Tensorflow, Keras, Scikit-learn or similar
  6. Hands on experience with RDBMS such as Postgres or MySQL
  7. Experience building REST APIs using DRF or Flask
  8. Comfort with Git repositories, branching and deployment using Git
  9. Working experience with Docker
  10. Basic working knowledge of ReactJs
  11. Experience in deploying Django applications to AWS,Digital Ocean or Heroku
Read more
B2C ecommerce Lifestyle Brand
B2C ecommerce Lifestyle Brand
Agency job
via Qrata by Prajakta Kulkarni
Bengaluru (Bangalore)
7 - 15 yrs
₹15L - ₹25L / yr
Financial accounting
Audit
Finance
Compliance

The responsibilities would include, but not be limited to, the following:

Financial Reporting: You will be providing timely and accurate financial reporting to management together with strategic insights on the company s financial position. 

 

Accounting Systems and Processes - Understanding requirements, identifying, evaluating and implementing the most suitable accounting system/ tools needed to support the accounting needs of the organization

 

Implementing best in class accounting practices and Internal Control procedures considering:

  • Accounts Payables - Purchase to Procurement Cycle & Policies, SOPs and SLAs
  • Accounts Receivables - Billing Processes and Systems to raise timely invoices and perform ageing analysis
  • Revenue and Cash Reconciliations and suggesting and implementing SOPs and SLAs

 

Financial Closure - Ensure timely and accurate monthly closures. Consistent analyzing of financial data and presenting financial reports in an accurate and timely manner; clearly communicate monthly, quarterly, and annual financial statements; monitor progress, changes and keep senior leadership abreast of the financial status;

 

Audit - Ensure timely year end financial closures – Statutory, Tax and IFC. Handle end to end audit process and ensure timely completion of audits

 

Compliances and knowledge - Understand the applicability and ensure compliance with all the relevant statutes impacting the company. Keep abreast with all regulations impacting the companies accounting, compliance and reporting requirements as well as those impacting the company’s operations. Understanding of Income Tax, GST, imports and exports, FDI Regulation, Companies Act, and other tax regulations

 

Automation - Identify and implement processes to automate all routine repetitive tasks.


Assisting leadership in the annual budgeting and planning process; administering and reviewing all financial plans and comparing to actual results with a view to identifying, explaining and correcting variances as appropriate;  

 Leveraging strengths of the finance team members; providing clarity on the roles and responsibilities; developing and implementing training programmes to maximize and help them reach optimal individual and organizational goals; 

Read more
Semperfi Solution
at Semperfi Solution
1 recruiter
Ambika Jituri
Posted by Ambika Jituri
Bengaluru (Bangalore)
2 - 4 yrs
₹4L - ₹8L / yr
Payroll Management
Payroll
Payroll administration
Human Resource Management System (HRMS)
Human Resources (HR)
+3 more

Job Description

JOB DESCRIPTION

•    Oversee the payroll operations in US and Canada, Knowledge of EMEA payroll will be added advantage

•    Provide direct support and governance to third-party payroll vendors. Implement, direct, and maintain 

        procedures to ensure accurate and timely processing of payroll outside the U.S., in conjuncture with HR.

•    Processing changes in employees’ employment lifecycle in accordance with country payroll calendar and 

        global guidelines (new hire, transfer, termination, time & attendance, benefits, payroll)

•    Proper data input and for necessary corrections in the HR systems (Workday, ADP tools)

•    Running payroll processes, controls, reconciliation

•    Collaboration with members of the country's local team on HR-related topics

Mandatory Skill

•    Basic knowledge of North America payroll and how payroll works in general

•    Excellent analytical and problem solving with confidence to make decisions and manage escalations

•    Must be highly engaging, confident communicator, and detail orientated.

•    Experience on ADP WFN, Workday, and Ceridian day force 

•    B. Com / M. Com with 0.6 to 1-year relevant experience.

•    Strong verbal and written communication skills.

•    Team player and ability to work with a strict timeline.

•    Flexible to work in US shifts.

•    Good in Microsoft Office.

•    Ability to take ownership of the work.

•    Ability to manage the stakeholders independently.

. SHIFT TIMING: 5 AM to 2 PM

Skills

North American payroll,

Read more
Magicflare Software Services
Akshata Bhosle
Posted by Akshata Bhosle
Pune
3 - 15 yrs
₹3L - ₹15L / yr
skill iconJava
skill iconSpring Boot
Microservices
Hibernate (Java)
skill iconHTML/CSS
+1 more

Designation    : Java Developer

Experience      : 3 - 10 Yrs

Location           : Baner, Pune

Notice period : Immediate to 30 Days
  • Strong at Core Java and OOPs concepts
  • Exposure to Spring, Spring Boot and Spring Security
  • Exposure to implementation of RESTful APIs
  • Exposure to programming using Queues and No SQL database
  • Good understanding about JavaScript, JQuery and HTML
  • Good understanding about Data Structures and Multithreaded Programming
  • Good understanding about Design Patterns
Good understanding about Standard and Secure Coding practices
Read more
Airtribe
at Airtribe
1 recruiter
Dhaval Trivedi
Posted by Dhaval Trivedi
Bengaluru (Bangalore)
2 - 7 yrs
₹15L - ₹25L / yr
skill iconReact.js
skill iconVue.js
skill iconJavascript
skill iconHTML/CSS

We are looking for a software engineer who:

🙋 is curious and asks a lot of questions!

🤤 has good product taste.

⚡️ is passionate about writing clean code.

🕵 has strong problem solving skills.

🖥 can turn 1-pager specs into detailed features.

❣️ loves / appreciates automated testing!

😇 is humble, kind and has a good taste of sarcasm.

💻 has hands-on experience with JavaScript.


☀️ Non-mandatory, but nice to have:

👶🏻 worked in an early-stage startup.

🤟🏻 built and led a small engineering team.

✨ 2+years of experience.

💻 open source enthusiast.

🦄 You are passionate about teaching, learning and creator economy.


🤔 What's the interview process like?

We try to close the interview process within 3 days.
Take us through what excites you the most about this role/challenge.
A flexible project round.
Discussion with founders.

 
Read more
Yojito Software Private Limited
Tushar Khairnar
Posted by Tushar Khairnar
Pune
1 - 5 yrs
₹4L - ₹10L / yr
skill iconJavascript
Fullstack Developer
skill iconReact.js
skill iconPostgreSQL
MySQL
+1 more

Yojito is looking for motivated self-driven full stack engineer who can lead internal modules on his own. This role is for founding team member so deserving candidate will have lot of opportunities to grow into bigger roles and carry bigger responsibilities.

 

Aptitude Desired

  • Self Driven, Open to learning on the job
  • Comfortable in fast moving environment, ready to break and fix things quickly
  • Focus on getting shit done

 

Experience Required

  • At least 1 year of Professional experience
  • Must have worked and delivered application which is running in production
  • Experience in Managing production application

 

Skills Required

  1. Core Java
  2. Javascript - Sound knowledge of Javascript Eco-system
  3. ReactJS
  4. PostgreSQL and Basic Database Administration
  5. AWS Cloud - EC2, Lambda, Cognito
  6. Basic Shell Scripting and OS Administration
Read more
Beiing
at Beiing
1 video
8 recruiters
Deleted User
Posted by Deleted User
Remote only
2 - 4 yrs
₹3L - ₹8L / yr
IT Recruiter
IT Recruitment
Tech Recruiter
Technical Recruiter
Recruitment/Talent Acquisition
+3 more
Are you a self-motivated recruiter who would like to learn the search algorithm for LinkedIn, Twitter and other untapped hacks?

Lets Talk!

Our Preference:
- Prefer Diversity but open on potential
- Multitasking and Analytical stalwart
- Handled complex businesses
- Partner management in a global environment
- Interpret data on the fly.

You will have a combination of 3 aspects (i) Exceptional Talent Acquisition functional knowledge (ii) Strong Eye For Business (iii) Superior Interpersonal Skills

Key Responsibilities:
- Source > Engage > Convert
- Identify the best online sourcing channels for different requirements.
- Use technologies to locate, engage and attract prospective candidates
- Identify the top-performing employees at talent competitors and use the right messages to reach high-quality applicants.
- Organize targeted outreach events in the industry and on-site in our office

Required :
- 2+ of core recruiting or related experience.

What do WE Serve?
- Roles derived thru 'Engineering Community'- Developers, Product Management from Mid Level to Leadership Hires

Who do WE serve?
Our Potential Clientele - Tech Start-Ups, Tech Products & E-commerce

Reach out Beiing.in
#hiringrecruiters #recruiterjobs #techhiring #beiingrecrutrs #everythingrecruiting
Read more
OneFin
at OneFin
6 recruiters
Abhash Anand
Posted by Abhash Anand
Bengaluru (Bangalore)
0 - 3 yrs
₹4L - ₹5L / yr
skill iconPython
Tech Support
Communication Skills

We are looking for an Integration Engineer to assist our rapidly growing customer base. As part of our integration team, you will be the primary point of contact for all integrations.


You would be responsible for helping our clients integrate with OneFin APIs, configuring our system for clients and providing ongoing help to them to resolve any issues. Eventually you should be able to automate common issues and development of solutions.


You’ll fit right in with us if you have a passion for unraveling complex issues and are comfortable working in a fast-paced environment. If you’re looking to work in an open, collaborative environment side-by-side with our development engineers to help customers and shape future product design, we can’t wait to hear from you!


Responsibilities

  • Understand and explain APIs to clients.
  • Help clients integrate OneFin APIs.
  • Research and identify solutions to issues during integration.
  • Escalate unresolved issues to appropriate internal teams (e.g. software developers).
  • Become a product expert for clients.
  • Configure OneFin system for customized usage by clients.
  • Identify and write internal and external technical articles or knowledge-base entries, like typical troubleshooting steps, workarounds, or best practices, how-to guides etc.
  • Automate solution of common issues using Python.
  • Help live clients resolve issues and coordinate with the development team for issue resolution.

Requirements

  • BS/B.Tech. in Computer Science, Engineering, or equivalent.
  • Strong verbal and written communication skills.
  • Experience in writing code in Python.
  • Understanding of web based systems.
  • Proficient in understanding and writing JSON.
  • Experience in SQL databases.
  • Experience working with REST APIs.
  • Excellent analytical skills, passion for pinning down technical issues, and solving problems.
  • Enjoys a fast-paced startup environment.
Read more
NJS InfoTech
at NJS InfoTech
1 recruiter
Abhilash S
Posted by Abhilash S
Chennai
2 - 4 yrs
₹2.5L - ₹3.5L / yr
skill iconJavascript
skill iconHTML/CSS
ASP.NET
ASP.NET AJAX
skill iconC#
+2 more
- Developing front end website architecture.

- Designing user interactions on web pages.

- Developing back end website applications.

- Creating servers and databases for functionality.

- Ensuring cross-platform optimization for mobile phones.

- Ensuring responsiveness of applications.

- Working alongside graphic designers for web design features.

- Seeing through a project from conception to finished product.

- Designing and developing APIs.

- Meeting both technical and consumer needs.

- Staying abreast of developments in web applications and programming languages.
Read more
Peppo Technologies Private Limited
Rukhsana Aziz
Posted by Rukhsana Aziz
Remote, Bengaluru (Bangalore)
2 - 5 yrs
₹6L - ₹15L / yr
Product Management
Project Management
product manager
Product Strategy
skill iconAmazon Web Services (AWS)
+6 more

About Peppo


https://www.peppo.co.in">Peppo is a fair food ordering utility. It helps restaurants manage both the demand and the delivery sides of their business, on the cloud.


The simplest way to think of Peppo is that it is a backend for restaurants that takes them online, not on just one channel but on all of them. App publishers that integrate with Peppo, will see every restaurant that uses Peppo and can enable food ordering through their own front-end.


On the fulfilment side, Peppo allows restaurants to plug into an aggregated delivery fleet on which it helps restaurants choose between various providers to optimise between delivery costs and performance.



About the Role


We are looking for an experienced Business Development Manager with first-rate system administration and cloud systems management skills to join our retail platform team. In this role, you’ll be making some of the most significant decisions for the company. You need to have strong problem solving capabilities, be a team player and have great communication skills. You also need to be goal-oriented, have the ability to understand the core architecture and take up responsibility of product deployment and scaling. You must be a highly technical, hands-on system admin with passion for devops and scaling.


We value those with an entrepreneurial spirit and those who bring experience from established organizations. You ought to be comfortable in dealing with lots of moving pieces. You must have excellent attention to detail; and you should be flexible and  comfortable to learn new technologies and systems.


The opportunity is ideal for someone early in their career who learns by doing. This is a high-exposure role and you will learn what it really looks like in the early days of a startup.


We offer a friendly, casual, collaborative working environment that is mission-driven and results-oriented. Our small office is in a great space in Bangalore. Due to the COVID situation, we are committed to having a fully remote engagement.




Responsibilities 

  • Collaborate with the Tech Lead on product deployment and scaling
  •  Responsible for communicating and reporting to the tech lead
  •  Setup new environments as well as maintain existing ones
  • Participate in technical design and architecture reviews from the deployment and scaling point of view
  •  Write technical documentation
  • Automate stuff
  • Infrastructure as code
  • Be aware of costs and skilled enough to squeeze


Skills and Requirements


We are looking at your experience not just in terms of the years you’ve clocked but the aptitude to get things done. Here’s the skills that your job would entail, so please make sure you highlight the following in any capacity you have demonstrated - professional, freelance or hobbyist.


  • 2+ years of software development experience (professional, freelance or hobbyist). Github profiles matter.
  • Strong proficiency in AWS products with certifications
  • Deep understanding of Infrastructure as code tool like Ansible
  • Understanding of tools like Gitlab, Jenkins etc required for code management and continuous delivery 
  • Python or Bash scripting skills
  • Experience with deployment frameworks, practices and processes
  • Demonstrated skills in deploying, releasing, and maintaining highly scalable web applications
  • Bonus if you know AWS CloudFormation or Terraform
  • Good communication skills and ability to work independently or in a team.

Employment Type

  • Full-time
  • Remote/On-Site 

Our Preferred Resume Format

  • Polished resume with list of projects clearly listed (with responsibilities you held)
  • Links to interesting projects that you worked on (professional, freelance or hobbyist)
  • Blogs written and any other public contributions you made

Our Interview Process

  1. Resume evaluation: We will screen all incoming CVs and invite candidates for next round, fitting our job profile description.
  2. Case study:  If you are one of the shortlisted candidates, you will be sent a case study to solve.
  3. Phone screening: we will follow up with a phone screening round for better understanding of the CV, technical proficiency, experience etc.
  4. F2F Round(s): The next round is a direct face-to-face discussion over a video call.

Job Perks

  • Small team with an opportunity to have a steep learning curve. 
  • Have a meaningful impact on end customers and sellers on their experience with digital tools.
  • Work on redefining the e-commerce experience by building cooperatives for the micro-services era. This makes Peppo a perfect home for those looking to pursue compassionate capitalism.
  • Train under a diverse and accomplished set of team leads, mentors and investors who have worked in government and big tech.
  • Holistic development guaranteed as you will grow in an environment that prizes lateral thinking allowing you to supplement your core responsibilities with additional functions.
  • Competitive compensation and flexibility to work from anywhere since Peppo uses the best of productivity tools.

Peppo is an equal opportunity employer. We're excited to work with talented and empathetic people no matter their race, caste, color, gender, sexual orientation, religion, national origin, physical disability, mental well-being, or age. Our code of conduct reflects the kind of company we strive to be, and we celebrate our diversity for that truly makes us create products that cater to the world.

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos