Cutshort logo
Thoughtworks logo
Lead Consultant: Data Engineer
Lead Consultant: Data Engineer
Thoughtworks's logo

Lead Consultant: Data Engineer

Vidyashree Kulkarni's profile picture
Posted by Vidyashree Kulkarni
9 - 15 yrs
Best in industry
Remote only
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
skill iconScala
Data Structures
Data modeling
Data security
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

Job responsibilities
  • You will partner with teammates to create complex data processing pipelines in order to solve our clients' most complex challenges
  • You will collaborate with Data Scientists in order to design scalable implementations of their models
  • You will pair to write clean and iterative code based on TDD
  • Leverage various continuous delivery practices to deploy, support and operate data pipelines
  • Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
  • Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
  • Create data models and speak to the tradeoffs of different modeling approaches
  • Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
  • Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications

Technical skills

  • You have a good understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
  • You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
  • Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
  • You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
  • Working with data excites you: you can build and operate data pipelines, and maintain data storage, all within distributed systems
  • You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
  • Professional skills
  • You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
  • An interest in coaching, sharing your experience and knowledge with teammates
  • You enjoy influencing others and always advocate for technical excellence while being open to change when needed
  • Presence in the external tech community: you willingly share your expertise with others via speaking engagements, contributions to open source, blogs and more
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

IDFC Bank
Agency job
via Pluginlive by Harsha Saggi
Chennai
8 - 12 yrs
₹50L - ₹75L / yr
Engineering Management
skill iconAmazon Web Services (AWS)
cicd
Team leadership
Monitoring
+1 more

Role & Responsibilities:

AWS Cloud Management:

• Lead the design, deployment, and management of AWS cloud infrastructure to ensure

scalability, security, and reliability.

• Oversee the implementation of best practices for cloud resource utilization.

Automated Provisioning:

• Drive the development and maintenance of automated provisioning processes for

infrastructure deployment, leveraging tools such as Terraform and Packer.

• Continuously enhance deployment workflows to optimize efficiency.

Financial Operations (FinOps):

• Implement and champion FinOps practices to optimize cloud costs and resource

utilization.

• Conduct regular cost analysis and identify opportunities for cost savings without

compromising performance.

Infrastructure as Code (IaC):

• Collaborate with teams to implement and maintain IaC scripts for infrastructure

configuration and deployment.

• Ensure version control and consistency in infrastructure code across projects.

Team Leadership:

• Lead and mentor a team of DevOps engineers, providing technical guidance and

support.\

• Foster a collaborative and innovative team culture focused on continuous improvement.

Continuous Integration/Continuous Deployment (CI/CD):

• Drive the implementation and maintenance of CI/CD pipelines to automate software

delivery processes.

• Ensure seamless and reliable application deployments across environments.

Monitoring and Optimization:

• Implement monitoring solutions for cloud resources and applications.

• Proactively identify and address performance bottlenecks, ensuring optimal system

performance.

Read more
Mauritius
4 - 6 yrs
₹10L - ₹15L / yr
Selenium
Manual testing
Software Testing (QA)
Test Automation (QA)
Appium
+3 more

Note: This role is physically based out of Mauritius - and you will be required to relocate. All relocation related costs will be taken care of (work permit/visa/shared accommodation/flight tickets)


We are seeking an accomplished and detail-oriented Senior QA Engineer to join our dynamic team. As a Senior QA Engineer, you will play a pivotal role in ensuring the quality and reliability of our software products through meticulous manual testing processes.


Your extensive experience and expertise will be instrumental in shaping the user experience by meticulously testing and validating software functionality, identifying defects, collaborating with cross-functional teams to deliver high- quality solutions, and coaching junior QA testers.


We are seeking an accomplished and detail-oriented Senior QA Engineer to join our dynamic team. As a Senior QA Engineer, you will play a pivotal role in ensuring the quality and reliability of our software products through meticulous manual testing processes.


Your extensive experience and expertise will be instrumental in shaping the user experience by meticulously testing and validating software functionality, identifying defects, collaborating with cross-functional teams to deliver high-quality solutions, and coaching junior QA testers.


Key Performance Indicators:


• Team's defect detection rate and test coverage.

• Ability to independently evaluate, plan, and execute testing activities.

• Timely delivery of test results and defect reports.

• Effective mentorship and professional development of team members.

• Consistent adherence to project timelines and quality standards.

Read more
Akrivia HCM
SiddarthPraneeth K
Posted by SiddarthPraneeth K
Hyderabad
6 - 14 yrs
₹15L - ₹40L / yr
Engineering Management
skill iconJava
skill iconNodeJS (Node.js)
skill iconAndroid Development
Relational Database (RDBMS)

Position Overview:


We are seeking an experienced Engineering Manager to join our dynamic team. The ideal candidate will possess a strong technical background, with at least 6+ years of expertise in software development, architecture, and team leadership. As the Engineering Manager, you will play a pivotal role in driving the technical direction of our software development team, architecting robust solutions, and ensuring the successful delivery of high-quality software products.


Key Responsibilities:


·   Architect and lead the development of scalable, high-performance web applications utilizing Node.js / Javascript and MySQL with good to have experience in Angular.

·   Provide technical leadership and guidance to the software development team, overseeing backend and frontend development efforts.

·   Collaborate with cross-functional teams to define technical requirements, establish project timelines, and align software development strategies with business objectives.

·   Drive the implementation of best practices in software engineering, including code quality standards, unit testing, code reviews, and CI/CD processes.

·   Mentor and coach engineering team members, fostering a culture of continuous learning and technical excellence.

·   Lead technical discussions, identify opportunities for innovation, and evaluate emerging technologies to enhance our product offerings.

·   Analyze system architecture and design, ensuring optimal performance, scalability, and reliability of our software solutions.

·   Partner with stakeholders to define technical roadmaps, prioritize features, and deliver impactful solutions that meet customer needs.

·   Lead by example, demonstrating a commitment to collaboration, transparency, and continuous improvement within the engineering organization.


Qualifications:


·      Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.

·      Proven track record as an Engineering Manager or in a similar leadership role within software development.

·      Proficiency in JavaScript, with expertise in Node.js.

·      Experience working with technologies such as Redis, GraphQL, Messaging Brokers like Kafka or RabbitMQ, Integrating third party APIs

·      Experience in architecting and developing high-load, scalable web applications using modern frontend and backend technologies.

·      Strong proficiency in RESTful API design, microservices architecture, and distributed systems.

·      Demonstrated expertise in database design, optimization, and management, particularly with MySQL.

·      Familiarity with frontend technologies such as Angular desirable.

·      Experience with Agile development methodologies and DevOps practices.

·      Excellent communication skills, with the ability to effectively collaborate with cross-functional teams and stakeholders.

·      Experience with modern development tools and technologies, including Git, Jenkins, Docker, Kubernetes, etc.


If you possess the requisite skills and are passionate about driving innovation in the HR tech industry, we invite you to join our team at Akrivia HCM

Read more
Click400 Technologies Pvt Ltd
Jodhpur
1 - 5 yrs
₹2L - ₹4L / yr
Search Engine Optimization (SEO)
On-page Optimization
Social media management

The ideal candidate will analyze, review, and implement changes to websites so they are optimized for search engines. This candidate will be able to implement actionable strategies that will improve site visibility.

Responsibilities

  • Review and analyze client sites for areas needing improvement
  • Prepare detailed strategy reports
  • Create and launch campaigns
  • Improve clients 'rank' in major search engines


Qualifications

  • Bachelor's degree in Information Technology or related field
  • 3+ years' of technical experience
  • Strong analytical skills
  • Understanding of all search engines and functions as well as marketing


Read more
Casey Foods Opc Pvt Ltd
at Casey Foods Opc Pvt Ltd
14 recruiters
Hr Caseyfoods
Posted by Hr Caseyfoods
Bhubaneswar
3 - 5 yrs
₹1L - ₹3L / yr
Digital Marketing
Social Media Marketing (SMM)
Search Engine Marketing (SEM)
Web Analytics
skill iconGoogle Analytics
+3 more

Responsibilities

 Analyze user engagements (e.g. click-through and bounce rates)

 Report on web traffic from all social media

 Build and support SEO strategies, including optimizing keywords in content marketing projects

 Identify the habits of our online customers and suggest ways to reach a broader audience

 Maintain a cohesive strategy across all platforms to increase our brand awareness

 Coordinate with our digital team and the Marketing department to design advertising campaigns

 Ensure timely responses to customers and followers’ queries and comments

 Advise other employees on their social media activity (e.g. how to respond to comments and questions by customers and what to share on personal or company accounts)

 Research how emerging social networks and features can benefit our company

 

Requirements:

 

 Previous work experience as a Social Media Analyst, Social Media Coordinator, or similar role

 Hands-on experience with social media platforms and digital marketing campaigns

 In-depth understanding of SEO, keyword research, and Google Analytics

 Experiences with social media management tools, like Buffer and Hootsuite

 Familiarity with online content (experience with WordPress and content management systems preferred)

 Ability to identify target audience preferences and trends

Excellent communication skills

 Time management and multitasking skills

 Additional qualifications in digital technologies or social media management will add plus points in your performance.

 

Read more
Artivatic
at Artivatic
1 video
3 recruiters
Layak Singh
Posted by Layak Singh
Bengaluru (Bangalore)
3 - 7 yrs
₹6L - ₹15L / yr
skill iconPython
skill iconJava
RESTful APIs
skill iconScala
Cassandra
+4 more
About Artivatic :Artivatic is technology startup that uses AI/ML/Deeplearning to build intelligent products & solutions for finance, healthcare & insurance businesses. It is based out of Bangalore with 20+ team focus on technology. Artivatic building is cutting edge solutions to enable 750 Millions plus people to get insurance, financial access and health benefits with alternative data sources to increase their productivity, efficiency, automation power and profitability, hence improving their way of doing business more intelligently & seamlessly. Artivatic offers lending underwriting, credit/insurance underwriting, fraud, prediction, personalization, recommendation, risk profiling, consumer profiling intelligence, KYC Automation & Compliance, automated decisions, monitoring, claims processing, sentiment/psychology behaviour, auto insurance claims, travel insurance, disease prediction for insurance and more. We have raised US $300K earlier and built products successfully and also done few PoCs successfully with some top enterprises in Insurance, Banking & Health sector. Currently, 4 months away from generating continuous revenue.Skills : - Building server-side logic that powers our APIs, in effect deploying machine learning models in production system that can scale to billions of API calls - Scaling and performance tuning of database to handle billions of API calls and thousands of concurrent requests - Collaborate with data science team to build effective solutions for data collection, pre-processing and integrating machine learning into the workflow - Collaborate, provide technical guidance, and engage in design and code review for other team members. - Excellent Scala, cassandara, architect, api, software, python, Java programming and software design skills, including debugging, performance analysis and test design - Proficiency with at least one Scala, GoLang, Python micro frameworks like Flask, Tornado, Play, Spring etc. with experience in building REST APIs - Experience or understanding in building web crawlers, data fetching bots etc. - Experience with design and optimisation of Neo4j, cassandra, NoSQL databases, PostGreSQL, Redis, Elastic Search - Familiarity with one of the cloud service providers, AWS or Google Compute Engine - Computer Science degree with 4+ years of backend programming experience Experience : 3 Years+ Location : Sony World Signal, Koramangala 4th Block, Bangalore
Read more
ACUE
at ACUE
1 recruiter
Brad Felix
Posted by Brad Felix
Remote, New York
3 - 9 yrs
$75K - $135K / yr
Data Structures
Databases
Data Visualization
Data management
Relational Database (RDBMS)

Working closely with the Product group and other teams, the Data Engineer is responsible for the development, deployment and maintenance of our data infrastructure and applications. With a focus on quality, error-free data delivery, the Data Engineer works to ensure our data is appropriately available and fully supporting various constituencies across our organization. This is a multifaceted opportunity to work with a small, talented team on impactful projects that are essential to ACUE’s higher education success. As an early member of our tech group, you’ll have the unique opportunity to build critical systems and features while helping shape the direction of the team and the product.

Read more
Casey Foods
at Casey Foods
7 recruiters
Swati Ray
Posted by Swati Ray
Remote, Cuttack
3 - 7 yrs
₹2L - ₹5L / yr
Marketing
Business Development
Channel Sales
Sales
Presales
+2 more
  • A Bachelor’s degree, with sales as your core dream.
  • Proven Sales Experience.
  • Fantastic track record of meeting sales target.
  • A passion towards multitasking and team building.
  • Ability to work under pressure.
  • Strong problem-solving, organizational and management skills.
  • Excellent negotiation, convincing and consultative sales expertise.
  • Effective communication skills.
  • Exceptional customer orientation knowledge.
Read more
Appxigo Media
at Appxigo Media
2 recruiters
Rohan Salgaonkar
Posted by Rohan Salgaonkar
Goa
0 - 2 yrs
₹1L - ₹4L / yr
Business Development
Sales
Client Servicing
Mobile App Marketing
Media Buying
We are hiring for the position of "Business Development Executive". Requirements* # Graduate in any stream. # Ability to talk fluent English with clients on phone, email and in person if necessary. # Knowledge of Microsoft Office. # Prior experience in sales is plus point. Email us with your CV attached at [email protected]. Visit http://appxigo.com/career.html for more info.
Read more
Rang De
at Rang De
3 recruiters
Shalitha Hegde
Posted by Shalitha Hegde
Bengaluru (Bangalore)
2 - 4 yrs
₹4L - ₹9L / yr
Below The Line Marketing (BTL)
partnerships
Branding
Brand Management
Inbound Marketing
+2 more
Rang De is a pioneering social initiative which provides cost-effective credit to low income households in India. • Brand Management o Understand and own the branding elements and drive proper usage o Manage consistency of the brand across touchpoints • Brand Partnerships o Identify and ideate on relevant partnerships for the brand o Create and execute co-branding campaigns o Build strategic relationships and partner with key industry players, agencies and vendors • BTL Marketing o Assist in planning of all below the line activities for the brand o Lead execution of concept development, design and final output for BTL elements and events o Deploy successful marketing campaigns and own their implementation from ideation to execution • Others o Measure and report performance of marketing campaigns, gain insight and assess against goals Requirements • Demonstrable experience in marketing along with the potential and attitude required to learn • Numerically literate, comfortable working with numbers, making sense of metrics and processing figures with spreadsheets • Good taste, a sense of aesthetics and a love for great copy and witty communication What you will need to succeed • Be passionate about marketing and communication; more importantly you realize the power of marketing in building relationships and trust • Have the ability to think on your feet and work in a dynamic work environment
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos