Cutshort logo
Thoughtworks logo
Lead Consultant - Data Engineer
Lead Consultant - Data Engineer
Thoughtworks's logo

Lead Consultant - Data Engineer

Sunidhi Thakur's profile picture
Posted by Sunidhi Thakur
10 - 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
skill iconPython
skill iconScala
skill iconJava
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra

Lead Data Engineer

 

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

 

Job responsibilities

 

·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems

·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges

·      You will collaborate with Data Scientists in order to design scalable implementations of their models

·      You will pair to write clean and iterative code based on TDD

·      Leverage various continuous delivery practices to deploy, support and operate data pipelines

·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available

·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions

·      Create data models and speak to the tradeoffs of different modeling approaches

·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product

·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process

·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes

 

Job qualifications Technical skills

·      You are equally happy coding and leading a team to implement a solution

·      You have a track record of innovation and expertise in Data Engineering

·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations

·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop

·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting

·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions

·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems

·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments

·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems

 

Professional skills


·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers

·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives

·      An interest in coaching others, sharing your experience and knowledge with teammates

·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

LogiNext
at LogiNext
1 video
7 recruiters
Roshni Rai
Posted by Roshni Rai
Mumbai, Navi Mumbai
8 - 10 yrs
₹20L - ₹22L / yr
User Interface (UI) Design

Job Details

Description

We are looking for a passionate Senior User Experience Designer to join our fast growing team at LogiNext. You’ll collaborate with Product Managers and other UI designers to design new features, translate concepts into living and breathing prototypes, and rapidly iterate on interactions, animations, and details to deliver the best user experience. You will be responsible for conceptualizing & creating highly interactive user interfaces across all supported platforms.

 

You are passionate about design and are driven to create solutions for our clients that combine business objectives, design principles, and continuous user research into a compelling user experience. You have experience in designing a consistent and adaptable platform-based approach to user experience within a technology-driven and Software-as-a-Service (SaaS) based environment. You are a compulsive problem-solver with excellent visualization and communication skills.

 

Responsibilities: 

  • Gather, analyse & process data to determine the user needs & enhance the user experience
  • Research & learn new, or re- emerging front- end technologies that facilitate improved user experience.
  • Conceptualise designs through storyboards & concept presentations
  • Design beautiful digital interfaces and present ideas in a compelling manner
  • Perform usability testing with prototypes
  • Create wireframes & prototypes to create a perfect user interface 
  • Create the best visual communication design with graphic design, website design, drawing and illustration, animation, client discussion and standard layouts.
  • Mentor other team members in conceptualising and visually articulating design solutions

 

Requirements:

  • Bachelor’s degree or higher in Arts/Commerce/Science/Technology 
  • 8 to 10 years of experience in UI/UX designing
  • Must have experience in designing user interfaces for B2B SaaS Products
  • Must have excellent experience using tools such as Sketch, Photoshop, Adobe Illustrator
  • Able to work and thrive in a fast-paced, rapidly changing work environment
  • Should have excellent communication skills, with an ability to convey ideas clearly & precisely
  • Must have leadership skills & a good team player
  • Must be pro-active & a self-starter


Read more
WebAppMate - Fly on IT India Pvt Ltd
Preeti Gupta
Posted by Preeti Gupta
Remote only
2 - 6 yrs
₹3L - ₹7L / yr
skill iconReact Native
skill iconReact.js
skill iconiOS App Development
skill iconAndroid Development
2+ years of professional experience working with React Native.
Firm grasp of JavaScript (or Typescript) and its nuances, including ES6+ syntax.
Experience working with Swift, Objective C, and Java/Kotlin a plus but not required.
Experience with architecting and implementing component-based UI frameworks and design systems
Read more
MSMEx
at MSMEx
6 recruiters
Sujata Ranjan
Posted by Sujata Ranjan
Remote, Pune, Mumbai
4 - 10 yrs
₹10L - ₹30L / yr
skill iconReact Native
Babel
webpack
CI/CD
skill iconJenkins
+13 more

We are looking for a Senior React Native developer with 5 - 6 years of experience, in building performant mobile applications on Android & iOS platforms. You will be responsible to Architect, build React Native applications.

 

We are a fast growing product based startup operating out of Chennai.

 

Responsibilities

  • Build pixel-perfect, buttery smooth UIs across Android and iOS.
  • Technical design of complex mobile applications
  • Leverage native APIs for deep integrations with both platforms.
  • Translating designs and wire-frames into high quality code
  • Diagnose and fix bugs and performance bottlenecks for performance that feels native.
  • Maintain code and write automated tests to ensure the product is of the highest quality.

 

Requirements

  • 5-6 years of demonstrable experience in designing and developing mobile apps using react-native.
  • Ability to write well-documented, clean JavaScript code
  • Rock solid at working with third-party dependencies and debugging dependency conflicts.
  • Familiarity with native build tools, like XCode, Gradle, Android Studio and Visual Studio Code.
  • Understanding of REST APIs, the document request model, and offline storage.

 

Below are a few perks of joining our team:

  • Competitive salary
  • Fully remote job
  • Creative Problem Solving and Entrepreneurial Thinking
  • Fast-Paced Environment
  • Consistent Engagement from Senior Leadership
Read more
Confianz Global
sajitha ns
Posted by sajitha ns
Remote only
4 - 9 yrs
Best in industry
skill iconPython
skill iconDjango
skill iconFlask
Odoo (OpenERP)
ORM
+2 more

Position: Sr. Developer / Lead Developer

Experience: 4 - 9 Years

Work Location: Remote - Work from anywhere / Technopark, Trivandrum

Qualification: B Tech / BE / BCA / MCA / BSC Computers

Skills: Odoo ERP , Python, Postgresql, MYSQL

 

Required Technical Competency & Qualifications

 

v In Depth understanding of Odoo ERP and all the default Odoo modules.

v Good Knowledge in ORM methods, Python and JavaScript.

v Strong Knowledge on API integration.

v Capable of working on Odoo framework on existing app and custom module.

v Enhance applications, develop and configure features and functionalities that support business requirements

v Good Knowledge in code repositories- Github.

v Should have good technical support skills.

v Good Analytical, Communication and interpersonal skills.

v Ability to work with a close bound team structure.

v Ability to work under minimal supervision.

v Should be able to work in client facing roles.

Read more
Casey Foods
at Casey Foods
7 recruiters
Anindita Parida
Posted by Anindita Parida
Remote only
2 - 5 yrs
₹3L - ₹6L / yr
Business Development
Sales
Communication Skills
Sales management

Roles & Responsibility:

  • Develop a growth strategy focused both on financial gain & customer satisfaction.
  • Contacting potential clients to establish rapport & arrange meeting.
  • Researching Organizations & individuals to find new opportunities.
  • Growing business through the development of new leads and new contracts.

Requirements:

  • Candidates with Bachelor’s degree in any stream.
  • Experience required at least 2-5 years in sales, marketing & related field
  • Representative skill with communication
  • Excellent Organizational skill
Read more
Its Product based company
Its Product based company
Agency job
via Myna Solutions by Venkat B
Remote only
4 - 8 yrs
₹6L - ₹10L / yr
skill icon.NET
Web API
skill iconAngular (2+)
Job Title:Dot Net Developer

Work Location: Hyderabad

Experience:4 to 8 Years

Package:Upto 12 LPA

Product Based Company

Notice Period:Immediate Joiners.

Its a Full Time Opportunity with Our Client

Mandatory Skills: WebAPI, Angular 4+ , MVC and SQL


Job Description:

--Expertise in Web API is most preferable.
--Good experience needed in Angular 4+ implementation.
--Must have very good exposure and experience working with C#,ASP.Net, MVC, Entity Framework, Web Service, Java Script, jQuery and SQL Server.
--Strong Knowledge of software implementation best practices.
--Strong experience in debugging and working with n-tier architecture (UI, Business layer and Data Access layer) along some experience with service oriented architectures(SOA)
--Ability to design and optimize SQL server stored procedures.
--Solid understanding of object oriented programming (OOP).
--Experience using version control (Git/Subversion)
--Experience using Jira and Confluence
--Develop and enhance new and existing software applications
--Mentor and train other team members
--Gain knowledge of the Energy Industry
--Provide documentation and training on the solution
Read more
Zeta Suite
at Zeta Suite
4 recruiters
Sandhya Devi
Posted by Sandhya Devi
Bengaluru (Bangalore), Hyderabad
7 - 12 yrs
₹30L - ₹70L / yr
skill iconJava
Spring
skill iconAmazon Web Services (AWS)
NOSQL Databases
Technical Architecture
What does the job look like?
 Building highly-scalable and secure payments platform
 Primary owners of one or more components of the platform and will drive innovation in
your area of ownership
 Working with various product teams gathering requirements and adding capabilities
 Working with some of the smartest people in the industry and will have ample opportunity to learn and grow
 Using cutting-edge cryptography to secure payments beyond industry standards
 Deriving actionable insights by mining TBs of data
 Building a low-level infrastructure that aims to push the boundaries of network
performance
 Participating actively in recruitment and nurturing of engineers as awesome as you

What do we look for?
 Review and influence new evolving design, architecture, standards and methods with
stability, maintainability, and scale in mind
 Identify patterns and provide solutions to class of problems
 Research, evaluate and socialize new tools, technologies, and techniques to improve the value of the system
 Be able to multitask, prioritize and handle dependencies with minimal oversight
 From a technology perspective, you should have the knowledge and/or experience in a
reasonably sized subset of the following ( the more, the merrier!! )
 Worked on one or more large scale java applications
 Good understanding of nuances of distributed systems, scalability, and availability
 Good knowledge of one or more relational and NoSQL databases and transactions
 Shrewd focus on latency and throughput of services
 In-depth understanding of concurrency, synchronization, NIO, memory allocation and GC
 Experience with IaaS clouds like AWS/Google Cloud, Azure, OpenStack etc..
 Experience in working with Message Brokers and Application Containers
 Great ability to mentor and train other team members
Read more
Xpresslane
at Xpresslane
1 recruiter
Mithileshkumar R
Posted by Mithileshkumar R
Bengaluru (Bangalore)
1 - 3 yrs
₹4L - ₹8L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+4 more

We’re seeking engineers who are ready to work with new technologies and architectures in a forward-thinking organization that’s always pushing boundaries.


Here, you will take complete,
end-to-end ownership of projects across the entire stack. Our ideal candidate should have a firm understanding of web frameworks, APIs, databases, and multiple back end languages. You’ll be joining a small team working at the forefront of new technology, solving the challenges that impact both the front end and back end architecture, and ultimately, delivering amazing global user experiences.

Objectives for this Role
Work across the full stack, building highly scalable distributed solutions that enable positive user experiences and measurable business growth
Develop new features and infrastructure development in support of rapidly emerging business and project requirements
Assume leadership of new projects from conceptualization to deployment
Ensure application performance, uptime, and scale, maintaining high standards of code quality and thoughtful application design
Work with agile development methodologies, adhering to best practices and pursuing continued learning opportunities Daily and Monthly Responsibilities
Participate in all aspects of agile software development including design, implementation, and deployment
Architect and provide guidance on building end-to-end systems optimized for speed and scale
Work primarily in Golang, Java, JavaScript and React
Engage with inspiring designers and front end engineers, and collaborate with leading back end engineers as we create reliable APIs
Collaborate across time zones via Slack, GitHub comments, documents, and frequent video conferences


Required Skills and Qualifications
Bachelor’s degree in computer science, information technology, or engineering
1+ years of experience building large-scale software applications
Understanding of building web applications
Understanding of designing and integrating RESTful APIs
Knowledge of Golang/Java, React, and JavaScript
Excellent debugging and optimization skills
Interest in learning new tools, languages, workflows, and philosophies to grow

Read more
Zydelo
at Zydelo
1 recruiter
Aastha Sharma
Posted by Aastha Sharma
Remote only
4 - 6 yrs
₹5L - ₹10L / yr
skill iconPython
skill iconDjango
skill iconAmazon Web Services (AWS)
SQL
NOSQL Databases

We are looking for a Backend Developer who has 4-6 years of experience in designing, developing, and implementing backend services using Python and Django.

- Responsibilities-

- Design highly scalable, testable code and follow Test Driven Development methodology 

 

- Able to write well-organized, modularised code with test cases.

- Contribute to the design and architecture of our backend APIs and deployment of microservices

- Ensure adherence to engineering best practices and maintain the overall quality of our codebase.

- Work with the product team to translate powerful ideas into everyday business value.

- Skills-

- Back-end programming language: Python

- Familiarity with Django or Flask framework

- Familiarity with AWS and Elastic Search

- Experience in SQL and NoSQL databases with an insight into various data modeling use cases

- Experience with system & unit testing

- Familiarity with containerized deployment

- Proficiency with Git

- Sound with data structures and algorithms and have a good understanding of design patterns, software architectures

Read more
Digital Aristotle
at Digital Aristotle
2 recruiters
Digital Aristotle
Posted by Digital Aristotle
Bengaluru (Bangalore)
3 - 6 yrs
₹5L - ₹15L / yr
skill iconDeep Learning
Natural Language Processing (NLP)
skill iconMachine Learning (ML)
skill iconPython

JD : ML/NLP Tech Lead

- We are looking to hire an ML/NLP Tech lead who can own products for a technology perspective and manage a team of up to 10 members. You will play a pivotal role in re-engineering our products, transformation, and scaling of AssessEd

WHAT ARE WE BUILDING :

- A revolutionary way of providing continuous assessments of a child's skill and learning, pointing the way to the child's potential in the future. This as opposed to the traditional one-time, dipstick methodology of a test that hurriedly bundles the child into a slot, that in-turn - declares- the child to be fit for a career in a specific area or a particular set of courses that would perhaps get him somewhere. At the core of our system is a lot of data - both structured and unstructured. 

 

- We have books and questions and web resources and student reports that drive all our machine learning algorithms. Our goal is to not only figure out how a child is coping but to also figure out how to help him by presenting relevant information and questions to him in topics that he is struggling to learn.

Required Skill sets :

- Wisdom to know when to hustle and when to be calm and dig deep. Strong can do mentality, who is joining us to build on a vision, not to do a job.

- A deep hunger to learn, understand, and apply your knowledge to create technology.

- Ability and Experience tackling hard Natural Language Processing problems, to separate wheat from the chaff, knowledge of mathematical tools to succinctly describe the ideas to implement them in code.

- Very Good understanding of Natural Language Processing and Machine Learning with projects to back the same.

- Strong fundamentals in Linear Algebra, Probability and Random Variables, and Algorithms.

- Strong Systems experience in Distributed Systems Pipeline: Hadoop, Spark, etc.

- Good knowledge of at least one prototyping/scripting language: Python, MATLAB/Octave or R.

- Good understanding of Algorithms and Data Structures.

- Strong programming experience in C++/Java/Lisp/Haskell.

- Good written and verbal communication.

Desired Skill sets :

- Passion for well-engineered product and you are - ticked off- when something engineered is off and you want to get your hands dirty and fix it.

- 3+ yrs of research experience in Machine Learning, Deep Learning and NLP

- Top tier peer-reviewed research publication in areas like Algorithms, Computer Vision/Image Processing, Machine Learning or Optimization (CVPR, ICCV, ICML, NIPS, EMNLP, ACL, SODA, FOCS etc)

- Open Source Contribution (include the link to your projects, GitHub etc.)

- Knowledge of functional programming.

- International level participation in ACM ICPC, IOI, TopCoder, etc

 

- International level participation in Physics or Math Olympiad

- Intellectual curiosity about advanced math topics like Theoretical Computer Science, Abstract Algebra, Topology, Differential Geometry, Category Theory, etc.

What can you expect :

- Opportunity to work on the interesting and hard research problem, to see the real application of state-of-the-art research into practice.

- Opportunity to work on important problems with big social impact: Massive, and direct impact of the work you do on the lives of students.

- An intellectually invigorating, phenomenal work environment, with massive ownership and growth opportunities.

- Learn effective engineering habits required to build/deploy large production-ready ML applications.

- Ability to do quick iterations and deployments.

- We would be excited to see you publish papers (though certain restrictions do apply).

Website : http://Digitalaristotle.ai


Work Location: - Bangalore

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos