Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
Spark
Hadoop
Big Data
Data engineering
PySpark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Series A Funded product Startup
Agency job
via Qrata by Blessy Fernandes
Chennai
1 - 2 yrs
₹3L - ₹6L / yr
Content Writing

Responsibilities


● Develop and execute a comprehensive social media strategy aligned with Rocketlane's overall marketing goals and target audience.

● Manage our LinkedIn, Twitter, and Instagram pages to ensure consistent brand messaging and engagement.

● Create and publish engaging posts, articles, images, and videos that resonate with our target audience.

● Monitor social media trends, industry developments, and competitor activities to identify opportunities for optimization.

● Collaborate cross-functionally with the marketing, design, and product teams to ensure consistent brand messaging and a cohesive online presence.

● Actively engage with followers and respond to comments, messages, and inquiries promptly and professionally.

● Implement strategies to drive lead generation, pipeline growth, and conversion through social media channels.

● Develop and maintain a content calendar to plan and organize posts, campaigns, and initiatives.

● Analyze social media performance using relevant metrics and tools, and provide regular reports with actionable insights to improve engagement and conversion rates.

● Collaborate with the content team to ensure social media content aligns with broader content marketing strategies.

● Create high-quality written content, including blogs, e-books, and other forms of thought leadership materials.

● Contribute to the creation of product marketing content, highlighting Rocketlane's features, benefits, and unique value proposition.


Qualifications

● Bachelor's degree in Literature, Marketing, Communications, Business, or a related field preferred.

● Strong understanding of social media platforms, trends, algorithms, and best practices.

● Excellent written and verbal communication skills, with the ability to craft engaging and persuasive content.

● Ability to work independently, manage multiple projects, and meet deadlines in a fast-paced environment.

● A genuine passion for social media marketing and a willingness to stay updated on industry trends.

Good-to-have

● 1-2 years of work experience as a social media manager or similar role, preferably within a B2B SaaS startup environment.

● Proficiency in social media management tools, analytics platforms, and scheduling software.

● Familiarity with content marketing strategies, SEO principles, and lead generation tactics.

● Basic knowledge of graphic design and video editing tools is a plus. Benefits

● Competitive salary and performance-based incentives.

● Opportunity to contribute to a rapidly growing startup and make a significant impact on its success.

● A collaborative work environment that values creativity and innovation

Read more
Delhi
4 - 12 yrs
₹3.5L - ₹4.5L / yr
Accounts receivable
Accounts payable
Account Management
Account reconciliation
Bank reconciliation
+6 more

Job description


We are seeking an experienced Billing Manager to oversee our billing operations and ensure our clients' timely and accurate invoicing. The ideal candidate will have excellent attention to detail, strong analytical skills, and the ability to manage a team.


The Billing Manager will create and maintain billing policies and procedures, ensure compliance with regulatory requirements, and develop strategies to improve billing efficiency and accuracy.


Role & responsibilities


BILLING & ERP

  • Oversee the preparation of statements and bills through our in house ERP
  • Maintain and/or ensure maintenance of client records related to invoicing and bill payment
  • Locate, or assist in the location of, hard-to-reach clients
  • Draft and distribute weekly reports of invoicing and billing metrics
  • Provide customer support to customers with disputes or inquiries concerning invoices or billing process
  • Supervise & CONTROL Discounts and Credit Note Issue
  • Oversee GST IRN Invoice generation
  • Monitor and Supervise Dispatch of Invoice on Email and Mail.


CREDIT CONTROL & CERDITOR MANAGEMENT

  • Manage the Receivables and Credit Control Team
  • Weekly Review of Creditors with team
  • Guide team on difficult cases
  • Manage key accounts requiring manual intervention personally
  • Receivables Management / MIS / Credit Control


REVENUE ACCOUNTING

  • Bulk Upload and manual entry Invoices on latest versions of Tally ERP
  • GST Invoice Checking
  • GST Return preparation
  • Credit Note, Debit Note, Advance Accounting
  • Party Ledger reconciliation
  • Creditor Management


CANDIDATE PROFILE

  • Proven work experience with ERP systems for Billing
  • Excellent verbal and written communication skills
  • Proficient in Microsoft Excel
  • Good understanding of collection practices and laws
  • Excellent interpersonal and supervisory skills
  • Ability to act with discretion, tact, and professionalism in all situations


Read more
Inspiredge IT Solutions
at Inspiredge IT Solutions
4 recruiters
Prasanthi Lekkala
Posted by Prasanthi Lekkala
Visakhapatnam
2 - 3 yrs
₹4L - ₹6L / yr
Active Directory
DNS
DHCP
Troubleshooting
International voice process

Role: Technical Support Engineer

Experience: 2 + years

Location: Visakhapatnam


Roles & Responsibilities:

• Answer incoming calls from end user, create a ticket in ITSM applications and Triage the Issue reported (or) Work on the requested service

• Triage Simple to Intermediate complexity hardware faults and software defects

• Work on Service Requests related to End-user configuration requests

• Proactively assign email tickets and make outbound calls to end customers on their Service Requests

• Work with end users on issues related to Windows Application & Software

• Troubleshooting hardware and computer peripherals such as printers and fax machines

• Perform password resets and provides required access to end users

• Diagnose and Isolate problems based on the nature of the Issue and raise Service request with vendors as needed

• Provide Complete management of Service Request from Case creation to Resolution

• Suggest improvements to process and workflow in the support center

• Identify problems related to chronic cases and work with Senior Engineering resources to identify the root cause • Support multiple different customer’s environments and ticketing systems.


Technical Skillset Requirements

• Knowledge of OSI reference model and Protocols

• Understanding of a Domain/corporate IT environment including PC & Laptop setup

• Provide technical support on Windows OS and MACOS platform

• Troubleshoot system specific issues related to PC & Laptop

• Working knowledge of Windows Active Directory and ability to add, remove users and perform password resets • Work on issues related to DNS and ability to isolate Network issues with Service Provider

• Troubleshoot issues related to Microsoft Applications (Outlook, O365, OneDrive, Teams)

• Troubleshoot system specific issues around peripherals - Printer, Fax and peripherals

• Knowledge of DHCP and troubleshoot issues related to Network

• Configuration and troubleshooting skills related to Microsoft Applications (Outlook, O365, OneDrive, Teams)

• Experience with Intel Endpoint Management Assistant, Microsoft Office 365 Admin Center Management, Intune and BitLocker.


Role Qualifications and Requirements:

• The following are minimum qualifications and requirements required for this role.

• Able to work independently with limited supervision and be successful in a team environment.

• 2-3 years of relevant work experience.

• Understanding of Operating systems and Desktop hardware.

• Ability and desire to quickly learn new technologies and concepts.

• Strong Oral and Written communication skills.

• Strong Interpersonal & Analytical skills.

• Adherence to QA Program.

• Ability to work well in a team environment.

• Work a flexible work schedule including nights and weekend shifts (24/7)

Read more
FlyyX Technologies Pvt Limited
Deepshikha Sethi
Posted by Deepshikha Sethi
Bengaluru (Bangalore)
3 - 7 yrs
₹7L - ₹15L / yr
skill iconRuby
skill iconRuby on Rails (ROR)

What will I be doing? 👩💻👨💻

  1. Leading parts of the product from inception to launch, and owning large parts of the product’s execution.
  2. Working with our product management and frontend team to build products with the goal of delighting and increasing the success of our users.
  3. Architecting, building, testing, and releasing product-facing features.
  4. Contributing to our side projects and free tools for the recruitment industry.

 

What do I need? 🤓

  1. 3+ years of industry experience in a backend engineering role, preferably building a SaaS product. You can demonstrate the significant impact that your work has had on the product and/or the team.
  2. Deep knowledge of a high-level programming language (for example, Ruby, Python, etc.) but it doesn’t need to be a language that we use here! Great people are effective and learn what we use quickly (or introduce us to better ways of working)
  3. Experience with scalable distributed systems, both built from scratch as well as on Managed Platforms.
  4. Willingness to learn and use new technologies.
  5. Extremely data-driven.
  6. Ability to debug complex systems.

 

Brownie points 🍰

  1. Relevant experience building large-scale data systems.

 

Feel free to apply even if you feel unsure about whether you meet every single requirement in this posting. As long as you're a quick learner, and are excited about changing the status quo for tech recruitment, we're happy to support you as you come up to speed with our tech stack.

Read more
Thinkwik
at Thinkwik
1 recruiter
Hardik Goswami
Posted by Hardik Goswami
Ahmedabad
2 - 4 yrs
₹3L - ₹6L / yr
skill iconAndroid Development
skill iconKotlin
skill iconJava
skill iconFlutter
skill iconReact Native
+1 more
Developed Five or more Android apps with Kotlin or Java; either deployed on Google
Play or available on Github
3+ years in mobile software development
Proficiency in Java, Kotlin, or C++.
Ability to use the Android Studio, including the Android SDK, with ease.●
Collaborating with UI and UX Designers, as well as Software Testers, to ensure that
each app is presentable and in perfect working order.
Experience with third-party libraries and APIs
Experience with automated testing and building
Experience with Git, Jenkins, or other version control tools
Ability to write readable code, create extensive documentation for existing code,
and refactor the previously written code into a readable state
Intermediate English skills
BONUS, IF YOU ALREADY KNOW: Flutter or React Native
Read more
Appcino Technologies Pvt. Ltd.
Jyoti Chandak
Posted by Jyoti Chandak
Remote, Jaipur, NCR (Delhi | Gurgaon | Noida), Pune
1 - 8 yrs
₹4.8L - ₹20L / yr
Salesforce
Salesforce Lightning
Salesforce Apex
Salesforce Visualforce
Salesforce.com

 Salesforce Developer Job Description:

The Salesforce Developer would need to have at least 2-8 years of experience. This candidate must be a motivated, innovative Senior Salesforce Developer who is prepared to make an immediate impact.

Responsibilities:

- Design, develop, test, document, and deploy Salesforce solutions.
- Collaborate with the pre-sales support and solutions architecture team on integrations and solution deployment.
- Communicate with project teams regarding status, technical issues, and creative solutions.
- Continue to grow as a developer, staying well-informed about best practices and new functionality on the Force.com platform.
-Help in hiring and building a team of junior salesforce developers.

Qualifications:

- Extensive experience working with Sales Cloud, Commerce Cloud, Service Cloud, Marketing Cloud.

- Experience with Salesforce APIs, Apex Triggers and Classes, SOQL, Force.com Tool and Toolkits.
- Experience in working with Salesforce Workflow Rules and Approvals, Visual Flow, Process Builder, and Salesforce limitations.
- Experience with REST/SOAP APIs (XML, JSON).
- User Interface: Salesforce Visual Force, HTML5, JavaScript, CSS, Lightening, jQuery, AJAX.
- Familiar with Salesforce Sites.
- Familiar with ETL tools (i.e., Mulesoft’s Dataloader).
- Experience in using testing automation tools like Selenium.
- Experience with Agile development processes, continuous integration, deployments.
- Working knowledge of Jira or similar project management/issue tracking tools.
- Strong understanding of design principles, technically scalable data modeling, Force.com development best practices.
- Develop accurate estimates on level of effort for timely project execution.
- Review and assure quality in all code entering the codebase.
- Continually evaluate and refractor code base for increased extensibility.
- Proficiency in developing unit testing with assertions for core functionality.
- Comprehensive experience in debugging and troubleshooting in Salesforce.
- Self-starter who has the ability to multi-task in a dynamic environment.
- Take responsibility for end-to-end solution delivery for their respective tracks.
- Customer-focused attitude.
- Detailed-oriented individual with the ability to rapidly learn and take advantage of new concepts, business models and technologies.
- Team player with strong communication skills.

 

Read more
Glint
at Glint
4 recruiters
Arvind Rajan
Posted by Arvind Rajan
Chennai
1 - 3 yrs
₹2.5L - ₹3L / yr
skill iconFlutter
DART
skill iconAmazon Web Services (AWS)
skill iconJavascript
MERN Stack

Responsibilities:

  • Develop and maintain the partner(fleet) application.
  • Sit with the core team to learn and address various complications through tech.
  • Attend meetings to understand the intricacies of the business and implement quick features/automation to improve the application.

 

Requirements:

  • If you can develop flutter applications, then go ahead and click Apply. Added Advantage - If you have experience in MERN stack.
Read more
Inc91
at Inc91
1 recruiter
Inc91 Media
Posted by Inc91 Media
NCR (Delhi | Gurgaon | Noida)
0 - 1 yrs
₹1.5L - ₹2.5L / yr
Content Writing
writing
Blogging
Creative Writing
Knowledge and prior experience of writing effective copy for all types of marketing
collaterals  Ability to generate grammatically correct content in clear and precise manner using
appropriate vocabulary and tone  Proficient in MS Office, PPT, Good knowledge of conducting online research (Finding information from Internet) Understanding and knowledge of website optimization  Understanding and knowledge of internet marketing, digital media and e-commerce.  
Role : Design & Creative
Industry Type : SOFTWARE, IT & ITES
Functional Area : Other Design
Employment Type : FTE
Read more
BrowserStack
at BrowserStack
1 video
8 recruiters
Aditi Singh
Posted by Aditi Singh
Mumbai
4 - 8 yrs
Best in industry
skill iconJava
skill iconPython
skill iconNodeJS (Node.js)
skill iconRuby
skill iconRuby on Rails (ROR)
● Good experience in at least one scripting language: Ruby, Nodejs, Python, AppleScript, Unix shell or similar ● Familiarity with one compiled language: C, Java, C ++, Go or similar ● Good knowledge of operating systems and networking concepts ● Reasonable knowledge of Windows and/or Linux operating systems ● Ability to work on Windows and Linux platform below the application layer, including file systems, kernels, custom installations, shell scripting, internal APIs, etc ● Aggressive problem diagnosis and creative problem solving skills ● Startup mentality, high willingness to learn, and hardworking ● Experience of 4+ years
Read more
Paysense Services India Pvt Ltd
Pragya Singh
Posted by Pragya Singh
NCR (Delhi | Gurgaon | Noida), Mumbai
2 - 7 yrs
₹10L - ₹30L / yr
skill iconPython
skill iconData Analytics
Hadoop
Data Warehouse (DWH)
skill iconMachine Learning (ML)
About the job: - You will work with data scientists to architect, code and deploy ML models - You will solve problems of storing and analyzing large scale data in milliseconds - architect and develop data processing and warehouse systems - You will code, drink, breathe and live python, sklearn and pandas. It’s good to have experience in these but not a necessity - as long as you’re super comfortable in a language of your choice. - You will develop tools and products that provide analysts ready access to the data About you: - Strong CS fundamentals - You have strong experience in working with production environments - You write code that is clean, readable and tested - Instead of doing it second time, you automate it - You have worked with some of the commonly used databases and computing frameworks (Psql, S3, Hadoop, Hive, Presto, Spark, etc) - It will be great if you have one of the following to share - a kaggle or a github profile - You are an expert in one or more programming languages (Python preferred). Also good to have experience with python-based application development and data science libraries. - Ideally, you have 2+ years of experience in tech and/or data. - Degree in CS/Maths from Tier-1 institutes.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos