Loading...

{{notif_text}}

The next CutShort event, {{next_cs_event.name}}, in partnership with UpGrad, will happen on {{next_cs_event.startDate | date: 'd MMMM'}}The next CutShort event, {{next_cs_event.name}}, in partnership with UpGrad, will begin in a few hoursThe CutShort event, {{next_cs_event.name}}, in partnership with UpGrad, is LIVE.Join now!
{{hours_remaining}}:{{minutes_remaining}}:{{seconds_remaining}}Want to save 90% of your recruiting time? Learn how in our next webinar on 22nd March at 3 pmLearn more

Big data Jobs

Explore top Big data Job opportunities for Top Companies & Startups. All jobs are added by verified employees who can be contacted directly below.

Data Engineer
Data Engineer

Founded 2015
Products and services{{j_company_types[1 - 1]}}
{{j_company_sizes[2 - 1]}} employees
{{j_company_stages[2 - 1]}}
{{rendered_skills_map[skill] || skill}}
Location icon
Bengaluru (Bangalore)
Experience icon
2 - 7 years
Experience icon
Best in industry5 - 15 lacs/annum

Should have experience in API development using node Express JS and flask. Sound knowledge of database design, Data warehouse design and development. Should have experience with version control systems like git. Very good knowledge of design patterns, algorithms, applications development and system design. Should be able to create data pipeline using Technologies like airflow/luigi. Should be flexible to work on any database management systems like relational or no SQL. Experience on dealing with real time streaming data and Batch data using latest tech stack like kafka, spark and flink. Very good experience in designing microservices and experience in orchestration tools like kubernetes and docker Swarm.

Job posted by
apply for job
apply for job
Prashant Verma picture
Prashant Verma
Job posted by
Prashant Verma picture
Prashant Verma
Apply for job
apply for job

Lead Data Engineer
Lead Data Engineer

via Lymbyc
Founded 2012
Products and services{{j_company_types[1 - 1]}}
{{j_company_sizes[3 - 1]}} employees
{{j_company_stages[3 - 1]}}
{{rendered_skills_map[skill] || skill}}
Location icon
Bengaluru (Bangalore), Chennai
Experience icon
4 - 8 years
Experience icon
Best in industry9 - 14 lacs/annum

Key skill set : Apache NiFi, Kafka Connect (Confluent), Sqoop, Kylo, Spark, Druid, Presto, RESTful services, Lambda / Kappa architectures Responsibilities : - Build a scalable, reliable, operable and performant big data platform for both streaming and batch analytics - Design and implement data aggregation, cleansing and transformation layers Skills : - Around 4+ years of hands-on experience designing and operating large data platforms - Experience in Big data Ingestion, Transformation and stream/batch processing technologies using Apache NiFi, Apache Kafka, Kafka Connect (Confluent), Sqoop, Spark, Storm, Hive etc; - Experience in designing and building streaming data platforms in Lambda, Kappa architectures - Should have working experience in one of NoSQL, OLAP data stores like Druid, Cassandra, Elasticsearch, Pinot etc; - Experience in one of data warehousing tools like RedShift, BigQuery, Azure SQL Data Warehouse - Exposure to other Data Ingestion, Data Lake and querying frameworks like Marmaray, Kylo, Drill, Presto - Experience in designing and consuming microservices - Exposure to security and governance tools like Apache Ranger, Apache Atlas - Any contributions to open source projects a plus - Experience in performance benchmarks will be a plus

Job posted by
apply for job
apply for job
Venky Thiriveedhi picture
Venky Thiriveedhi
Job posted by
Venky Thiriveedhi picture
Venky Thiriveedhi
Apply for job
apply for job

Principal Architect – Big Data Security Architecture
Principal Architect – Big Data Security Architecture

Founded 1998
Products and services{{j_company_types[3 - 1]}}
{{j_company_sizes[4 - 1]}} employees
{{j_company_stages[3 - 1]}}
{{rendered_skills_map[skill] || skill}}
Location icon
Dubai, Anywhere
Experience icon
12 - 18 years
Experience icon
Best in industry50 - 70 lacs/annum

• Design secure solutions in line with the business strategy and security requirements • Contribute to the enterprise security architecture through developing Strategies, Reference Architectures, Roadmaps, Architectural Principles, Technology Standards, Security Non-Functional Requirements, Architectural Decisions and Design Patterns. • Deliver cyber security architectural artifacts such as High Level Designs and Solution Blueprints. • Ensure the enforcement of security requirements in solution architecture • Contribute to educating other architects and engineering teams in designing and implementing secure solutions Technologies The candidate should have knowledge and experience in designing and implementing the following technologies and related domains • Cloud security • Identity and Access Management • Encryption, Masking and Key Management • Data Classification, Data Privacy and Data Leakage Prevention • Infrastructure security (Network/Servers/Virtualization) • Application Security • Endpoint Security • SIEM and Log Management • Forward and Reverse Proxy • Big Data Security • IoT Security • SAP Security (Preferred) Architecture Skills • Solid experience in developing security solution architecture • Solid experience and knowledge in TOGAF and SABSA or other Enterprise Architecture frameworks. • Strong experience in developing architectural artifacts including reference architectures, roadmaps, architectural principles, technology standards, security non-functional requirements, architectural decisions and design patterns • Strong experience in documenting existing, transition and target architectures. Cyber Security Skills • Solid experience in performing security risk assessments and controls implementation • Strong experience in designing and implementing security controls by utilizing the technologies mentioned in the technologies section above • Strong knowledge in offensive and defensive aspects of cybesecurity with solid understanding of attack techniques and abuse cases. • Strong knowledge and implementation experience of cyber security standards, frameworks and regulations such as ISO27001, NIST CSF, CSA CCM, PCI-DSS, GDPR

Job posted by
apply for job
apply for job
Apoorva Chauhan picture
Apoorva Chauhan
Job posted by
Apoorva Chauhan picture
Apoorva Chauhan
Apply for job
apply for job

Product Manager
Product Manager

Founded 1999
Products and services{{j_company_types[3 - 1]}}
{{j_company_sizes[4 - 1]}} employees
{{j_company_stages[1 - 1]}}
{{rendered_skills_map[skill] || skill}}
Location icon
Bengaluru (Bangalore)
Experience icon
6 - 15 years
Experience icon
Best in industry45 - 55 lacs/annum

Position: Senior Technical Product Manager for a Multi-National product Experience : 9+ Years Expertise looking for: Product Management in Data platforms - Work with Product development team, Data Scientists, Analysts to continually elaborate on business requirements to define a technology solution including system architecture and product specifications - Review work delivered by various teams to ensure it is as per specifications - Work closely with clients and sales teams to understand product feedback, ongoing requirements, customizations to continuously evolve and build a world-class products - Coordinate the product launch with marketing, customer care and sales groups - Ongoing product support, enhancements and life cycle management for existing products - Develop business case and product roadmap for new products - Support and collaborate with all facets of the business Desired skills: - 8+ years of software product management / development experience. - Minimum 5-8 years of product management experience in related field of data and analytics - Experience developing SaaS and analytics product offerings - Understanding and knowledge of structured and unstructured data, and big data architecture - This position may require travel to customer and non-customer sites Globally - Computer Science or Engineering degree or equivalent work experience in a Digital domain

Job posted by
apply for job
apply for job
Nagaraj Pasuvalingam (CareerNet) picture
Nagaraj Pasuvalingam (CareerNet)
Job posted by
Nagaraj Pasuvalingam (CareerNet) picture
Nagaraj Pasuvalingam (CareerNet)
Apply for job
apply for job

Machine Learning Engineer
Machine Learning Engineer

Founded 1996
Products and services{{j_company_types[2 - 1]}}
{{j_company_sizes[4 - 1]}} employees
{{j_company_stages[3 - 1]}}
{{rendered_skills_map[skill] || skill}}
Location icon
NCR (Delhi | Gurgaon | Noida)
Experience icon
2 - 5 years
Experience icon
Best in industry4 - 10 lacs/annum

Tradeindia is looking for Machine Learning Engineers to join its engineering team. The ideal candidate will have industry experience working on a recommendation engine, a range of classification and optimization problems e.g.: Collaborative filtering/recommendation User journey prediction Search ranking Text/ sentiment classification or spam detection Predictive analytics The position will involve taking Algorithm and Programming skills and applying them to some of the most exciting and massive SMEs user data. Qualification: M.tech, B.tech, M.C.A. Location: New Delhi About the company: Launched in the year 1996 to offer the Indian Business community a platform to promote themselves globally tradeindia.com has created a niche as India's largest B2B marketplace, offering comprehensive business solutions to the Domestic and Global Business Community through its wide array of online services, directory services and facilitation of trade promotional events. Our portal is an ideal forum for buyers and sellers across the globe to interact and conduct business smoothly and effectively. With an unmatched expertize in data acquisition and online promotion, Tradeindia subsumes a huge number of company profiles and product catalogs under 2,256 different product categories and sub-categories. It is well promoted on all major search engines and receives an average of 20.5 million hits per month. Tradeindia is maintained and promoted by INFOCOM NETWORK LTD. Today we have reached a database of 47,66,674 registered users (Jan 2019), and the company is growing on a titanic scale with a considerable amount of new users joining/registering everyday, under the innovative vision and guidance of Mr. Bikky Khosla, CEO.

Job posted by
apply for job
apply for job
Sher Thapa picture
Sher Thapa
Job posted by
Sher Thapa picture
Sher Thapa
Apply for job
apply for job

Fullstack Developer
Fullstack Developer

Founded
Products and services{{j_company_types[ - 1]}}
{{j_company_sizes[ - 1]}} employees
{{j_company_stages[ - 1]}}
{{rendered_skills_map[skill] || skill}}
Location icon
Hyderabad
Experience icon
1 - 5 years
Experience icon
Best in industry7 - 14 lacs/annum

Company Profile: Overview IMImobile is a UK based, global cloud communications software and solutions provider that enables companies to use mobile and digital technologies to improve and automate customer experience and engagement. We help to remove the barriers and complexities to digital customer engagement by providing a cloud-based communications platform and a suite of software products. These help our customers rapidly create and deploy Omni channel journeys, enabling them to: - reduce service delivery costs - improve marketing and customer service effectiveness - increase customer satisfaction - generate revenues Our technologies act as an intelligent software layer between existing IT systems, complex business processes and customer touch points across mobile, digital and social media channels. IMImobile's cloud software platform manages over 42 billion messages and 44 billion commerce transactions a year across the world. Organizations that trust us to deliver smarter digital customer engagement include Centrica, AA, O2, EE, BT, Foxtons, Pizza Hut, Vodafone, AT&T, MTN, three of the major retail banks in the UK and public-sector organizations in India, US and the UK. IMImobile is headquartered in London with offices in Hyderabad, Little Rock, Toronto, Dubai and Johannesburg and has over 1,100 employees worldwide. IMImobile is quoted on the London Stock Exchange's AIM market with the TIDM code IMO. IMImobile Products: • IMIbot.ai • IMIdigital • IMIcampaign • IMIconnect • Textlocal • IMIchat Who we are What we do Why clients use us Market leader of cloud communication software and services for digital interactions Provide software and tools to help businesses automate and improve customer interactions Best of breed – over 15 years’ experience in managing digital communication channels Profitable and cash generative growth for more than 10 years Enable businesses to use mobile and digital technologies to communicate better with customers whilst reducing costs Innovation – strong track record of delivering innovation for leading enterprises 950+ employees globally, HQ in London, offices in Atlanta, Dubai, Hyderabad and Johannesburg Enterprise grade – 24/7 global cloud managed service infrastructure Ideal Candidate: Position: Developer 2 to 7+ years of experience Job Location: Hyderabad Skill set: Strong foundation in object oriented programming in Java (Multi-threading, collections, JDBC etc..,) and server-side technologies (Servlets, JSP, Struts, Spring etc..,) Knowledge of writing performance-optimized SQL queries and stored procedure for an RDBMS (MySQL, Postgres, etc.) • Hands on into RestfulApi • Hands on into Spring Boot • Knowledge in any or all of these. o Relational DBs: MySQL, Red shift, Maria DB. • Knowledge in any or all of these. o Kafka, Hornet Queue or any other queuing technology. • Performance tuning of application code. • Performance tuning of DB queries. • Experience in any of the Bench Marking tools like JMeter, Load runner. • Working Experience in multithreaded/concurrent environment. • Basic Knowledge/ awareness of cloud solutions like AWS Lambda, S3, SES, KMS, EC2, IAM etc.. • JAVA (Core). • Analytical and Problem solving skills. • Basic knowledge or Awareness in Consul, Eureka, Netflix, and Microprocessor based frame works like Spring Boot.

Job posted by
apply for job
apply for job
uday kumar picture
uday kumar
Job posted by
uday kumar picture
uday kumar
Apply for job
apply for job

Senior Software Engineer
Senior Software Engineer

Founded 2010
Products and services{{j_company_types[1 - 1]}}
{{j_company_sizes[3 - 1]}} employees
{{j_company_stages[2 - 1]}}
{{rendered_skills_map[skill] || skill}}
Location icon
Kochi (Cochin)
Experience icon
4 - 9 years
Experience icon
Best in industry18 - 30 lacs/annum

About Our Tech Stack: We work with some of the hottest technologies on the block: Python, Django, Java, Scala, Clojure, ES6/7, React/Redux, Hadoop, Spark, Storm, Cassandra, Kafka, HBase, ElasticSearch, Redis, RabbitMQ, Netflix OSS libraries, just to name a few. We use AWS for production services, Git for revision control and Jenkins for builds and deployments. We push to production multiple times a day. The code is mostly a combination of JVM-based languages (Java, Scala, Clojure), Python and JavaScript/ClojureScript (React / Angular / Redux) in the frontend. About You You want to work with large datasets and implement algorithms that improve the quality and usefulness of our customer's contacts You are an awesome programmer, hacker and engineer. You have a solid mathematical foundation You can critically think through hard problems and emerge with robust, functional solutions You know what teamwork means and love to work with others to produce industrial-strength code Your software designs have resilience and performance baked into their DNA You're unphased by new tech and routinely crack open the source to truly understand it You are eager to learn and work in a fast-paced environment You can own things! And get it done Mandatory Skills and Experience 4-8 years of experience as a Software Engineer in a product organisation Expert in JVM-based languages and/or Python Experience in big data technologies like Hadoop and Spark is mandatory Solid experience and exposure to software architect/design methodologies and test-driven development, and strong software engineering principles. Expert in building scalable systems Sound understanding of CS and Data Structure concepts and implementation Solid experience with a variety of databases (SQL, NoSQL, In-Memory, Searchable, etc) Experience in working with Git and AWS Excellent written and verbal communication skills Experience leading/managing a group of Software Engineers in a product environment is a strong plus. Responsibilities You will work closely with the group of dynamic engineers of FullContact, both in India and abroad, to chase down programmatic challenges and day to day engineer-tasks. Be part of the architectural design/modification and implementation of the company’s products. Build robust APIs that can handle large volumes of live customer traffic Design and implement scalable software/systems Extend our high throughput search systems Build automated unit and functional testing around features and systems Work with a team to build super fast, scalable distributed systems Work with a team to solve difficult problems and then successfully implement it Work with Product management on understanding features Responsible for reviewing current systems, presenting ideas for system improvements. Compensation & Benefits Engineers choose their rig! Competitive salary based on experience, contribution and/or skillset Up to 12% of the annual salary as the additional bonus Complete one year, work from anywhere for a month Generous stock options as you grow Health Insurance 3 Week Minimum Vacation Policy Opportunity to attend events of national and international repute 13 Paid holidays Paid Maternity and Paternity Leaves Dedicated pantry with hot/cold beverages and snacks We love flip flops We love shorts and T-shirts too! A chance to help solve the world's contact information problem Do you think you can contribute to the company beyond the traditional expectations of your role and become key to the business? If yes, we have the following add-on exclusive for you. Work for a year, prove your mettle and grab it: >Rs. 150,000/- per year for Paid, Paid Vacation. Enjoy two weeks extra off from work, roam around anywhere in the world (go completely off-grid during this period – no work at all!) Work remote for a month - from anywhere in the world! About FullContact FullContact is a mass-scale Identity Resolution leader that connects fragmented customer data using social, digital and traditional consumer identifiers, plus provides extensive audience insights. FullContact provides marketers, agencies, media firms, and customer service providers with trusted, relevant and real-time data to deliver enhanced customer experiences in the moments that matter. FullContact’s consumer business, Contacts Plus, is one of the most popular contact management applications in the mobile world with more than 20MM users. We are a truly global company with headquarters in Denver, Colorado, and presence in Latvia, Israel, and India. The India office of FullContact is located in Kochi and houses over 100 associates FullContact is ranked #29 on OUTSIDE’s Best Places to Work 2017 list. Plus, FullContact, Inc. is listed #1100 among USA's Inc 5000 list of fastest-growing private companies. Read more: www.fullcontact.com About FullContact Culture and Values We at FullContact believe in being awesome with people. FullContact is built on the strong fundamentals of our core values. We look forward to welcoming the candidates who can match our values and competencies. Read about our values at fullcontact.com/about

Job posted by
apply for job
apply for job
Arunanand T A picture
Arunanand T A
Job posted by
Arunanand T A picture
Arunanand T A
Apply for job
apply for job

Backend Engineer - Data Integration/Machine Learning
Backend Engineer - Data Integration/Machine Learning

Founded 2017
Products and services{{j_company_types[1 - 1]}}
{{j_company_sizes[2 - 1]}} employees
{{j_company_stages[2 - 1]}}
{{rendered_skills_map[skill] || skill}}
Location icon
Bengaluru (Bangalore)
Experience icon
3 - 7 years
Experience icon
Best in industry6 - 15 lacs/annum

About Artivatic :Artivatic is technology startup that uses AI/ML/Deeplearning to build intelligent products & solutions for finance, healthcare & insurance businesses. It is based out of Bangalore with 20+ team focus on technology. Artivatic building is cutting edge solutions to enable 750 Millions plus people to get insurance, financial access and health benefits with alternative data sources to increase their productivity, efficiency, automation power and profitability, hence improving their way of doing business more intelligently & seamlessly. Artivatic offers lending underwriting, credit/insurance underwriting, fraud, prediction, personalization, recommendation, risk profiling, consumer profiling intelligence, KYC Automation & Compliance, automated decisions, monitoring, claims processing, sentiment/psychology behaviour, auto insurance claims, travel insurance, disease prediction for insurance and more. We have raised US $300K earlier and built products successfully and also done few PoCs successfully with some top enterprises in Insurance, Banking & Health sector. Currently, 4 months away from generating continuous revenue.Skills : - Building server-side logic that powers our APIs, in effect deploying machine learning models in production system that can scale to billions of API calls - Scaling and performance tuning of database to handle billions of API calls and thousands of concurrent requests - Collaborate with data science team to build effective solutions for data collection, pre-processing and integrating machine learning into the workflow - Collaborate, provide technical guidance, and engage in design and code review for other team members. - Excellent Scala, cassandara, architect, api, software, python, Java programming and software design skills, including debugging, performance analysis and test design - Proficiency with at least one Scala, GoLang, Python micro frameworks like Flask, Tornado, Play, Spring etc. with experience in building REST APIs - Experience or understanding in building web crawlers, data fetching bots etc. - Experience with design and optimisation of Neo4j, cassandra, NoSQL databases, PostGreSQL, Redis, Elastic Search - Familiarity with one of the cloud service providers, AWS or Google Compute Engine - Computer Science degree with 4+ years of backend programming experience Experience : 3 Years+ Location : Sony World Signal, Koramangala 4th Block, Bangalore

Job posted by
apply for job
apply for job
Layak Singh picture
Layak Singh
Job posted by
Layak Singh picture
Layak Singh
Apply for job
apply for job

Chief Technology Officer
Chief Technology Officer

Founded 2017
Products and services{{j_company_types[1 - 1]}}
{{j_company_sizes[2 - 1]}} employees
{{j_company_stages[2 - 1]}}
{{rendered_skills_map[skill] || skill}}
Location icon
Bengaluru (Bangalore)
Experience icon
8 - 15 years
Experience icon
Best in industry15 - 25 lacs/annum

About Artivatic :Artivatic is technology startup that uses AI/ML/Deeplearning to build intelligent products & solutions for finance, healthcare & insurance businesses. It is based out of Bangalore with 20+ team focus on technology. Artivatic building is cutting edge solutions to enable 750 Millions plus people to get insurance, financial access and health benefits with alternative data sources to increase their productivity, efficiency, automation power and profitability, hence improving their way of doing business more intelligently & seamlessly. Artivatic offers lending underwriting, credit/insurance underwriting, fraud, prediction, personalization, recommendation, risk profiling, consumer profiling intelligence, KYC Automation & Compliance, automated decisions, monitoring, claims processing, sentiment/psychology behaviour, auto insurance claims, travel insurance, disease prediction for insurance and more. We have raised US $300K earlier and built products successfully and also done few PoCs successfully with some top enterprises in Insurance, Banking & Health sector. Currently, 4 months away from generating continuous revenue.What We are Looking for?- We are looking experienced, seasoned technology professional or entrepreneur who have hands on building deep-tech/SaaS products. - Someone who think to build next billion dollar tech enterprise company based out of India which can solve finance/insurance/healthcare problem at massive scale. Someone who live for code and breathe for code. Skills/Experience :- More than 5+ years technology product building experience - Have either worked in startups or in large enterprises for scalable products- Knowledge in SCALA/Java/Python/Cassandara/Deeplearning/AI/ML/architecture- Data science/Algorithms/Statistics/Mathematics expert - Someone looking to build next billion dollar enterprise - Hands on-coding experience - Willing to work with small team- Willing to work in startup environment - Ability to lead technology team, execute projects well- Building innovative product ideas, algorithms and development - Someone who can built exceptional tech team, convert business problems in to technology solutions - Someone who think to start own companyCompensation & Equity :- Being startup, compensation is not high. Equity 3-4%. CTO Can also invest in company to buy more equity if want based on current valuation with some discount on it.

Job posted by
apply for job
apply for job
Layak Singh picture
Layak Singh
Job posted by
Layak Singh picture
Layak Singh
Apply for job
apply for job

Backend Developer - Python/Java/Performance Tuning
Backend Developer - Python/Java/Performance Tuning

Founded 2017
Products and services{{j_company_types[1 - 1]}}
{{j_company_sizes[2 - 1]}} employees
{{j_company_stages[2 - 1]}}
{{rendered_skills_map[skill] || skill}}
Location icon
Bengaluru (Bangalore)
Experience icon
2 - 5 years
Experience icon
Best in industry5 - 10 lacs/annum

About Artivatic :- Artivatic is a technology startup that uses AI/ML/Deep learning to build intelligent products & solutions for finance, healthcare & insurance businesses. It is based out of Bangalore with 20+ team focus on technology. The artivatic building is cutting edge solutions to enable 750 Millions plus people to get insurance, financial access, and health benefits with alternative data sources to increase their productivity, efficiency, automation power, and profitability, hence improving their way of doing business more intelligently & seamlessly. - Artivatic offers lending underwriting, credit/insurance underwriting, fraud, prediction, personalization, recommendation, risk profiling, consumer profiling intelligence, KYC Automation & Compliance, automated decisions, monitoring, claims processing, sentiment/psychology behaviour, auto insurance claims, travel insurance, disease prediction for insurance and more. - We have raised US $300K earlier and built products successfully and also done few PoCs successfully with some top enterprises in Insurance, Banking & Health sector. Currently, 4 months away from generating continuous revenue.Skills : - Building server-side logic that powers our APIs, in effect deploying machine learning models in production system that can scale to billions of API calls - Scaling and performance tuning of database to handle billions of API calls and thousands of concurrent requests - Collaborate with data science team to build effective solutions for data collection, pre-processing and integrating machine learning into the workflow - Collaborate, provide technical guidance, and engage in design and code review for other team members. - Excellent Scala, cassandara, architect, api, software, python, Java programming and software design skills, including debugging, performance analysis and test design - Proficiency with at least one Scala, GoLang, Python micro frameworks like Flask, Tornado, Play, Spring etc. with experience in building REST APIs - Experience or understanding in building web crawlers, data fetching bots etc. - Experience with design and optimisation of Neo4j, cassandra, NoSQL databases, PostGreSQL, Redis, Elastic Search - Familiarity with one of the cloud service providers, AWS or Google Compute Engine - Computer Science degree with 4+ years of backend programming experience Experience : 3 Years+ Location : Sony World Signal, Koramangala 4th Block, Bangalore

Job posted by
apply for job
apply for job
Layak Singh picture
Layak Singh
Job posted by
Layak Singh picture
Layak Singh
Apply for job
apply for job