Cutshort logo
Thoughtworks logo
Lead Consultant: Data Engineer
Lead Consultant: Data Engineer
Thoughtworks's logo

Lead Consultant: Data Engineer

Vidyashree Kulkarni's profile picture
Posted by Vidyashree Kulkarni
9 - 15 yrs
Best in industry
Remote only
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
skill iconScala
Data Structures
Data modeling
Data security
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

Job responsibilities
  • You will partner with teammates to create complex data processing pipelines in order to solve our clients' most complex challenges
  • You will collaborate with Data Scientists in order to design scalable implementations of their models
  • You will pair to write clean and iterative code based on TDD
  • Leverage various continuous delivery practices to deploy, support and operate data pipelines
  • Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
  • Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
  • Create data models and speak to the tradeoffs of different modeling approaches
  • Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
  • Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications

Technical skills

  • You have a good understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
  • You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
  • Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
  • You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
  • Working with data excites you: you can build and operate data pipelines, and maintain data storage, all within distributed systems
  • You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
  • Professional skills
  • You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
  • An interest in coaching, sharing your experience and knowledge with teammates
  • You enjoy influencing others and always advocate for technical excellence while being open to change when needed
  • Presence in the external tech community: you willingly share your expertise with others via speaking engagements, contributions to open source, blogs and more
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Talent Pro
Bengaluru (Bangalore)
5 - 8 yrs
₹40L - ₹50L / yr
Product Management

Bachelor’s degree in Computer Science,Engineering,Environmental Science or related field


5+ years in Product Management in Agritech and environmental technologies


Experience with Agile methodologies and product lifecycle management


Strong understanding of data-driven decision making and KPI tracking


Experience with A/B testing methodologies

Read more
All time design
Chennai
2 - 3 yrs
₹3L - ₹4L / yr
Communication Skills
Customer Relationship Management (CRM)
Time management
Sales

Job description :


All Time Design is looking for Business Development Manager. The ideal candidate will have a track record of new business pipeline generation over the phone within an Enterprise capacity and the ability to close opportunities directly.


Job responsibilities :


  • Growing revenue via prospecting, qualifying, selling and closing client accounts
  • Meeting Quarterly & Annual Revenue Targets
  • Managing perspective client relationships through all phases of the sales cycle
  • Providing a consultative solutions sales process to prospects
  • Conducting one-on-one and group sales presentations
  • Calling to establish new opportunities
  • Tracking customer information, forecasts and reports
  • Developing and maintaining prospect and customer list based on strategic marketing data and other sources for sales leads


Requirements:


  • Must have experience in SaaS/ Tech/ IT company.
  • 2+ years of sales experience focused on growing existing business or new business
  • Large account management or project management experience
  • Proven track record for closing large and mid-size companies
  • Ability to adapt, overcome objections, and learn complex solutions
  • Strong time management skills
  • Create new business opportunities through in-depth conversations and relationship building
  • Proven track record of growing business from an established client base
  • Strong time management skills
  • Consistent and documented track record for achieving monthly/quarterly/annual target metrics
  • Strong oral and written communication skills are a must
  • Ability to work in a fast paced, team environment with revenue deadlines
  • Working knowledge of computer applications such as Microsoft Office
  • Must have knowledge about CRM


Job Location: Anna Nagar, Chennai. Beside VR Mall.


Job Types: Full-time, Permanent


Supplemental Pay:

  • Commission pay


Shift:

  • Rotational shift


Work Location: In person


Read more
Prolance Services Pvt Ltd
Jaisimha Sathyanarayana
Posted by Jaisimha Sathyanarayana
Bengaluru (Bangalore)
1 - 5 yrs
₹12L - ₹18L / yr
plugin
Google SketchUp
sketchup
skill iconJavascript
skill iconRuby

You will be part of a team that is responsible for developing the one the best plugins for the modular furniture industry ever created for SketchUp. We at Prolance Services are on a mission to develop and deliver a revolutionary platform that will ultimately change the way the industry itself operates.

 

Responsibilities

  • Write clear quality code for SketchUp plugins using Ruby and JS
  • Interact with the software architecture team and convert ideas into workable features
  • Interact with UX designers and convert the designs to workable UI
  • Interact with REST APIs to fetch and push data
  • Detect and troubleshoot software issues at the code level

 

Qualifications

  • Strong knowledge of Ruby and JavaScript
  • Working knowledge of SketchUp 2018 (or higher) is a huge advantage
  • Strong debugging and troubleshooting skills
  • 3+ years of development experience
Read more
Insignian Infotech
Ahmedabad
2 - 5 yrs
₹2.4L - ₹8.4L / yr
skill iconHTML/CSS
skill iconJavascript
skill iconAngular (2+)
skill iconAngularJS (1.x)
ASP.NET
+2 more

Preferred work start time is 8AM IST (Reason for that is Client location is Australia)


We are seeking a skilled C# Developer to join our team. The ideal candidate will have a strong background in C# programming and experience in developing SSRS reports. Familiarity with Azure Functions is a plus. This role requires a quick learner who can adapt to new technologies and challenges with ease.


Responsibilities:

  • Develop and maintain applications using C#.
  • Create and manage SSRS reports to support business needs.
  • Optionally work with Azure Functions to build and deploy services.
  • Participate in all phases of the software development lifecycle.
  • Collaborate with cross-functional teams to define, design, and ship new features.
  • Ensure the performance, quality, and responsiveness of applications.
  • Identify and correct bottlenecks and fix bugs.
  • Help maintain code quality, organization, and automatization.


Qualifications:

  • Proven experience as a C# developer.
  • Strong knowledge of the .NET framework.
  • Proficient in creating and managing SSRS reports.
  • Experience with Azure Functions is advantageous but not required.
  • Excellent problem-solving skills and ability to work independently.
  • Adept at learning new technologies quickly.


Additional Notes:

  • The ideal candidate would be able to start their day at 8 AM IST to synchronize with the team in Perth, Australia. While this is highly preferred, it is not a strict requirement. Candidates should be prepared for early starts regardless to attend essential team meetings.


What We Offer:

  • Competitive salary and benefits package.
  • Opportunity to work on exciting projects with cutting-edge technologies.
  • A supportive and collaborative work environment.
  • Professional growth and development opportunities.


Job Type: Full-time

Read more
Leading Payment Solution Company
Leading Payment Solution Company
Agency job
via People First Consultants by Naveed Mohd
Chennai, Mumbai, Pune, Hyderabad, Bengaluru (Bangalore)
10 - 17 yrs
₹8L - ₹25L / yr
skill iconAmazon Web Services (AWS)
Windows Azure
Google Cloud Platform (GCP)
Cloud Computing
Microsoft Windows Azure
+5 more

About Company:

The company is a global leader in secure payments and trusted transactions. They are at the forefront of the digital revolution that is shaping new ways of paying, living, doing business and building relationships that pass on trust along the entire payments value chain, enabling sustainable economic growth. Their innovative solutions, rooted in a rock-solid technological base, are environmentally friendly, widely accessible and support social transformation.

Role Overview
  • Senior Engineer with a strong background and experience in cloud related technologies and architectures.
  • Can design target cloud architectures to transform existing architectures together with the in-house team.
  • Can actively hands-on configure and build cloud architectures and guide others.

Key Knowledge

  • 3-5+ years of experience in AWS/GCP or Azure technologies
  • Is likely certified on one or more of the major cloud platforms
  • Strong experience from hands-on work with technologies such as Terraform, K8S, Docker and orchestration of containers.
  • Ability to guide and lead internal agile teams on cloud technology
  • Background from the financial services industry or similar critical operational experience
  •  
Read more
CORE ENERGY
Saurabhi P
Posted by Saurabhi P
Ghansoli
8 - 15 yrs
₹10L - ₹15L / yr
New business development
Lead Generation
Team Management
Corporate Communications

Key Accountabilities:

·        Lead origination – conceptualize and develop implementable annual business plans to support growth of the Business Vertical / Organization. Meeting consultants, business influencers, EPC Contractors, OEMs.

·        Locate or propose potential business deals by contacting potential partners; discover and explore opportunities including comprehensive evaluation of opportunities and undertaking feasibility studies. Joint meeting with Applications team to understand project requirement, customer expectations, propose practical solution. Regular follow up and closing the deal.

·        Evaluate business potential and competition through continuous mapping of competing market players in terms of current business and new areas of business development.

·        Develop negotiating strategies by studying – OEM price inputs, Competition, Client requirements, Our capabilities.

·        Develop and nurture the BD team to work seamlessly with cross functional and business teams for achievement of desired results and timely submission of bids in the competitive bidding process.

·        Establish, build and maintain an excellent network in Oil and Gas Sector Companies, PSUs, LSTK/EPC Contractors, liquid customers, and industry associations to acquire market information, sustain current business as well as develop/incubate new businesses for growth.

·        Development of green field projects (Includes opportunities in D-O-N sector) and ensure adequate pipeline of projects/implementable ideas.

·        Constantly scout for attractive M&A opportunities to grow the business inorganically, especially in the areas of our interests.

·        Capture emerging O&M opportunities to retain the overall profitability for the business 


·        BE with additional qualifications, if any

At least 10 – 15 years’ experience in similar business.

Read more
CoreStack
at CoreStack
2 recruiters
Dhivya R
Posted by Dhivya R
Chennai
1 - 8 yrs
₹4L - ₹40L / yr
skill iconPython
skill iconDjango
skill iconFlask

CoreStack, an AI-powered multi-cloud governance solution, empowers enterprises to rapidly achieve Continuous and Autonomous Cloud Governance at Scale. CoreStack enables enterprises to realize outcomes such as 40% decrease in cloud costs and 50% increase in operational efficiencies by governing operations, security, cost, access, and resources. CoreStack also assures 100% compliance with standards such as ISO, FedRAMP, NIST, HIPAA, PCI-DSS, AWS CIS & Well Architected Framework (WAF). We work with many large global customers across multiple industries including Financial Services, Healthcare, Retail, Education, Telecommunications, Technology and Government.

CoreStack closed a $8.5 million Series A financing recently. CoreStack was recognized as IDC Innovator in Cloud Management Solutions and in the Gartner Magic quadrant for Cloud Management Platforms in 2020. Earlier in 2019, Gartner named CoreStack as a Cool Vendor in Cloud Computing. CoreStack is a Microsoft Azure Gold & Co-Sell Partner and Amazon AWS Advanced Technology Partner.

Job Description
• Lead a team of open source developers in building Cloud Products/Solutions
• Participate in R&D activities led by architects
• Contribute in product engineering and system integration
• Perform system integration for various private cloud platforms
• Communicate effectively with various stake-holders involved in the delivery process and getting stuff done
Skills Required
• Experience integrating/working with Openstack Cloud Platform is a must
• Must be well versed with Openstack EcoSystem
• An inquisitiveness to understand the intricacies at the code-level and at the same time understand the constituents of the bigger picture
• Hands-on hacker mentality with excellent coding skills and a passion to develop high-quality code
• Understand design patterns and their significance in software development
• Ability to context-switch between different problems at the same time efficiently and prioritize them properly before tackling them
• Must be able to inspire juniors and command the respect of peers with technical acumen and attitude
• Contribution to any open-source projects, blogging on technical topics, creation of any tool/framework/library, taking part in hackathons/coding challenges/workshops, being part of any technical group/forum will all be valued

CoreStack Offers

  • Competitive salary
  • Competitive benefit package with appreciable equity
  • Exciting, fast-paced and entrepreneurial culture
  • Health insurance and other company benefits
Read more
AI powered HR-tech startup
AI powered HR-tech startup
Agency job
via Unnati by Sarika Tamhane
Remote only
2 - 7 yrs
₹5L - ₹12L / yr
Search Engine Optimization (SEO)
SEO management
Digital Marketing
Work with an amazing set of people, who have come together to provide a common platform for all recruitment needs. Read on to know more.
 

Our client is a AI based HR-tech startup that provides high quality sourcing of profiles and jobs and pulls in data from multiple job portals to ease the process for their clients. Their systems allow their business clients to automate skill assessments as per their need or as per other sources if required. The machine learning system runs matchmaking algorithms and allows their clients to manage their hiring process.

 
The founding team and other professionals come with tens of years of experience with product management and AI-based solutions management. Based out of Pune, they manage hiring solutions for companies like Flipkart, Google, Uber, Amazon, Swiggy and Zoho among others.
 
As a SEO Specialist, you will be responsible for a ton of SEO activities- starting from keyword research to link building (& everything in-between!).

What you will do:


  • Working towards organic search optimization and ROI maximisation
  • Regularly performing thorough keywords research
  • Identifying key SEO KPIs
  • Monitoring redirects, click rate, bounce rate, and other KPIs
  • Preparing and presenting reports regularly
  • Identifying our buyer persona to better target identified audiences
  • Identifying problems and deficiencies and implementing solutions in a timely manner
  • Suggesting improvements in process and productivity optimization
  • Collaborating with web developers and marketing team
  • Staying up to date with the latest SEO and digital marketing trends and best practices

 

Desired Candidate Profile

What you need to have:

  • Core expertise in advanced SEO- including but not limited to on-page SEO, off-page SEO, brand signals, outreach & user experience
  • Experience in copy & content optimization, content strategy, content marketing, content amplification, etc.
  • Love for strategically a/b testing different things, collecting data, analyzing numbers, extracting insights & re-iterating the execution loop
  • Understanding of basic web technologies like HTML, CSS & JavaScript
  • Understanding of technical SEO
  • Ability to suggest action items for improvement
  • Understanding of data, numbers & their significance
  • Ability to make simple & complex deductions
  • Ability to make sense of data to make various kinds of direct or indirect interpretations & use that data to create simple highly actionable steps
Read more
Bengaluru (Bangalore)
3 - 9 yrs
₹10L - ₹15L / yr
skill iconGo Programming (Golang)
skill iconRuby on Rails (ROR)
skill iconPython
skill iconReact.js
Image Processing
+4 more
Opening for Senior Software Engineer leading Product Company
Job Location : Bangalore
Expereince : 3 to 9 Years
JD :



● Work break-down and orchestrating the development of components for each sprint
● Developing “Zero Defect Software” which is secured, instrumented, and resilient.
● Building Cloud-Native Application which runs on Cloud Platforms such as GCP / AWS.
● Creating design artifacts before implementation.
● Developing Test Cases before or in parallel with implementation.
● Ensuring the software developed passes static code analysis, performance, and load tests.
● Developing various kinds of components(such as UI Components, APIs, Business Components, Image Processing, etc.) 
● Inventing new approaches to detecting existing fraud.
● Staying ahead of the game by predicting future fraud techniques and building solutions to prevent them.

Skills Required:

golang, Elixir, Ruby on Rails, Python, react,

Candidate Attributes:

Must have
● An understanding of Product Development Methodologies
● Strong design skills in defining API Data Contracts / OOAD / Microservices / Data Models
● In-depth knowledge of either Elixir, GoLang, or Python, with a good understanding of OOPs and Concurrency concepts.
● Sound knowledge for User Interface development using modern Web Frameworks such as React.
● Experience in developing software in the Cloud such as GCP / AWS
● A passion to explore new technologies and express yourself through
technical blogs

Read more
A product based company under Vista Group of Venture Capital
A product based company under Vista Group of Venture Capital
Agency job
Bengaluru (Bangalore)
9 - 16 yrs
₹30L - ₹45L / yr
Engineering Management
Engineering head
Technical Architecture
Technical lead
skill iconJava
+10 more
We are looking for a talented Software Engineering Manager to join our engineering team. As a manager, you will lead a team participating in all aspects of the software development life cycle: scoping, design, coding, testing, implementation and support. You will help hire, train, mentor and lead a team of highly capable engineers. You will also help in the development of

Ours is a scalable microservices platform and geospatially-aware applications across multiple industries and form-factors. In this role, you must be able to multitask, quickly
adapt to new development environments, learn new systems, create reliable/maintainable
code, and find creative and scalable solutions to difficult and complex problems. You take
pride and ownership in your work as well as the overall contributions of your team. You must also have the ability to take a system-wide understanding, recognize use of system
components and disparate technologies and be able to diagnose and debug components
across an entire system. Your ability to communicate clearly and concisely (both written and verbal) is key, as is being a self-starter.

Primary Responsibilities:

● Build, train, mentor and lead a cross-functional agile team

● Help design, architect and develop advanced software solutions supporting multiple

projects and initiatives in a dynamic agile environment

● Collaborate with product owners and/or the business on requirements definition,

development of functional specifications, and design

● Wok in close collaboration with Scrum masters, Technical Product Manager and

Stakeholders within the team and function to co-own the deliverables

● Collaborate on or lead development of technical design and specifications as required

● Establish and lead best practices in software engineering

● Mentor and grow new employees on your team

● End to end feature development with a team size of 8-10 Dev & QA engineers across

levels.

Requirements:

● Bachelor’s Degree required, preferably in Computer Science or related field

● 10+ years of software development experience using both Frontend and Backend

technologies like - React.js/Angular.js, along with GoLang/Java/Python, or another object-oriented programming language

● 3+ years as an engineering lead or manager

● Experience with cloud technologies (AWS) and containerization (Docker/EKS) and Microservices

● Experience with SAFe Agile is preferred

Note: Role is full stack with more inclination to backend side.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos