We are looking for an outstanding Big Data Engineer with experience setting up and maintaining Data Warehouse and Data Lakes for an Organization. This role would closely collaborate with the Data Science team and assist the team build and deploy machine learning and deep learning models on big data analytics platforms.
Roles and Responsibilities:
- Develop and maintain scalable data pipelines and build out new integrations and processes required for optimal extraction, transformation, and loading of data from a wide variety of data sources using 'Big Data' technologies.
- Develop programs in Scala and Python as part of data cleaning and processing.
- Assemble large, complex data sets that meet functional / non-functional business requirements and fostering data-driven decision making across the organization.
- Responsible to design and develop distributed, high volume, high velocity multi-threaded event processing systems.
- Implement processes and systems to validate data, monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
- Perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Provide high operational excellence guaranteeing high availability and platform stability.
- Closely collaborate with the Data Science team and assist the team build and deploy machine learning and deep learning models on big data analytics platforms.
Skills:
- Experience with Big Data pipeline, Big Data analytics, Data warehousing.
- Experience with SQL/No-SQL, schema design and dimensional data modeling.
- Strong understanding of Hadoop Architecture, HDFS ecosystem and eexperience with Big Data technology stack such as HBase, Hadoop, Hive, MapReduce.
- Experience in designing systems that process structured as well as unstructured data at large scale.
- Experience in AWS/Spark/Java/Scala/Python development.
- Should have Strong skills in PySpark (Python & SPARK). Ability to create, manage and manipulate Spark Dataframes. Expertise in Spark query tuning and performance optimization.
- Experience in developing efficient software code/frameworks for multiple use cases leveraging Python and big data technologies.
- Prior exposure to streaming data sources such as Kafka.
- Should have knowledge on Shell Scripting and Python scripting.
- High proficiency in database skills (e.g., Complex SQL), for data preparation, cleaning, and data wrangling/munging, with the ability to write advanced queries and create stored procedures.
- Experience with NoSQL databases such as Cassandra / MongoDB.
- Solid experience in all phases of Software Development Lifecycle - plan, design, develop, test, release, maintain and support, decommission.
- Experience with DevOps tools (GitHub, Travis CI, and JIRA) and methodologies (Lean, Agile, Scrum, Test Driven Development).
- Experience building and deploying applications on on-premise and cloud-based infrastructure.
- Having a good understanding of machine learning landscape and concepts.
Qualifications and Experience:
Engineering and post graduate candidates, preferably in Computer Science, from premier institutions with proven work experience as a Big Data Engineer or a similar role for 3-5 years.
Certifications:
Good to have at least one of the Certifications listed here:
AZ 900 - Azure Fundamentals
DP 200, DP 201, DP 203, AZ 204 - Data Engineering
AZ 400 - Devops Certification

About netmedscom
About
Connect with the team
Similar jobs
-
Experience Level: Min 2+ years
-
JavaScript and react.
-
RESTful API’s, basic HTTP knowledge, GET/POST.
-
Experience using technologies like React, Redux, TypeScript, modern CSS frameworks and web pack.
-
Good Communication Skills
Technology: node js, DynamoDB / Mongo DB
Roles:
- Design & implement Backend Services.
- Able to redesign the architecture.
- Designing & implementation of application in MVC & Microservice.
- 9+ years of experience developing service-based applications using Node.js.
- Expert-level skills in developing web applications using JavaScript, CSS and HTML5.
- Experience working on teams that practice BDD (Business Driven Development).
- Understanding of micro-service architecture and RESTful API integration patterns.
- Experience using Node.js for automation and leveraging NPM for package management
- Solid Object Oriented design experience, and creating and leveraging design patterns.
- Experience working in a DevOps/Continuous Delivery environment and associated toolsets (i.e. Jenkins, Puppet etc.)
Desired/Preferred Qualifications :
- Bachelor's degree or equivalent experience
- Strong problem solving and conceptual thinking abilities
- Desire to work in a collaborative, fast-paced, start-up like environment
- Experience leveraging node.js frameworks such as Express.
- Experience with distributed source control management, i.e. Git
We are looking for a detail-oriented Manual Tester to join our QA team. This role is ideal for freshers or candidates with up to 1 year of experience who are eager to build a career in software testing and quality assurance.
Key Responsibilities
- Understand application requirements and functional specifications
- Execute manual test cases for web and/or mobile applications
- Perform functional, regression, smoke, and sanity testing
- Identify, document, and track bugs clearly
- Work closely with developers to reproduce and verify fixes
- Retest resolved issues and ensure quality before releases
- Participate in basic test planning and reporting activities
- Ensure applications meet expected quality standards
Job Title: Software Dev Engineer II
Location: Bangalore
Duration: 8 Months
Job Type: Contract
Work Type: Onsite
Job Description:
The top 3 responsibilities:
· Requirement gathering & Coding
·
Mandatory Requirements:
· 2+ years in Core Java, DSA.
· Strong coding experience
· Candidate based in Bangalore will be preferred
· Quick joiners will be preferred
· Candidate should have good communication skills
·
Education or Certification:
· Bachelors in CS, IT or BSC in CS
Notice: Immediate Joiners only
Shift timings: 9 AM- 6 PM IST some flexibility will be required after 6 PM IST
Location: Bangalore
Relevant Exp: 2+ years
Mode: All 5 days WFO
Type, Location
Mumbai, Maharashtra, India
Desired Experience
4+ years
Roles and Responsibilities :
Skills required :
- Strong knowledge of javascript programming, ReactJS, HTML5, CSS3, SASS, ES6 Strong knowledge of modern responsive design techniques
- Strong knowledge of stateless microservices (node/java/etc..), HTTPS/REST, JSON, Webpack/Grunt/Gulp
- Very good understanding and implementation experience of web application UI using OpenID Connect login/authentication
- Version Control – Git, CI/CD of UI projects(e.g. CircleCI, Travis CI, Jenkins), configuration and deployment of static UI assets
Must have skills :
- Must have at least 4 years of industry experience in white labeled Front End web application design & development
- Experience in Test Driven Development, Front End testing and performance optimization (e.g. Jest, unit testing, end-to-end testing)
Enterprise Minds, with core focus on engineering products, automation and intelligence, partners customers on the trajectory towards increasing outcomes, relevance, and growth.
Harnessing the power of Data and the forces that define AI, Machine Learning and Data Science, we believe in institutionalizing go-to-market models and not just explore possibilities.
We believe in a customer-centric ethic without and people-centric paradigm within. With a strong sense of community, ownership, and collaboration our people work in a spirit of co-creation, co-innovation, and co-development to engineer next-generation software products with the help of accelerators.
Through Communities we connect and attract talent that shares skills and expertise. Through Innovation Labs and global design studios we deliver creative solutions.
We create vertical isolated pods which has narrow but deep focus. We also create horizontal pods to collaborate and deliver sustainable outcomes.
We follow Agile methodologies to fail fast and deliver scalable and modular solutions. We are constantly self-asses and realign to work with each customer in the most impactful manner.
Pre-requisites for the Role
- Job ID-EMPY0120MS
- Primary skill: Python Developer, Django, Problem solving.
- Secondary skill: Rest, API
- Years of Experience: 4-7 Years
- Location: Remote
Budget- Open
NP- Immediate
PYTHON DEVELOPER
- Design, build, and maintain efficient, reusable, and reliable Python code
- Design and implement software platform with Microservices Architecture, based on AWS Lambda and Event sourced data
- Integration of data storage solutions {may include databases, key-value stores, notification queues, etc.}
- Integration with various backend monitoring tools
- Identify bottlenecks and bugs, and devise solutions to these problems
- Help maintain code quality, organization and automatization
- Participate in early product demonstrations to customersExperience required:
- Bachelor's or Masters in Computer Science or a related discipline
- 2-6 years of relevant professional experience
- Delivery of quality results within aggressive timelines
- Knowledge of software development processesSkills Required:
- Experience with Python, along with other common libraries/framework such as Flask, Celery, Django etc.,
- Good understanding with usage of Lambda in Python.
- Good understanding in testing frameworks like PyTest.
- Ability to work with IDEs like Visual Studio Code.
- Basic understanding in developing private PIP packages.
- Solid understanding of object-oriented programming.
- Familiarity with concepts of MVC, Mocking, ORM, and RESTful.
- A knack for writing clean, readable Python code.
- Ability to integrate multiple data sources and databases into one system.
- Ability to understand monitoring metrics, such as CPU, Memory, Disk Space, Network latency, and telemetry services.
- Understanding of fundamental design principles behind a scalable application.
- Understanding the fundamentals of RDBMS databases.
- Ability to work with PostgreSQL is a plus.
- Ability to work with AWS services like Lambda, Kinesis, SQS, SNS etc., is a plus.
- Proficient understanding of Git.
- Familiarity with continuous integration and continuous deployment.
- Effective verbal and written communication skills.
Graphic Designer-
Opportunity
Create marketing material for our growth initiatives, social media platforms, and branding collaterals. The ideal candidate should have an eye for clean, simple, and artful visual design. A successful candidate will be able to translate high-level requirements into visual elements that align with the language of our products
What you will do
- Develop out of the box campaigns for Social Media channels (Facebook, Twitter, Instagram, YouTube)
- Conceptualize original graphic design ideas that bring simplicity and user-friendliness to complex roadblocks
- Present concepts, participate in design/project critiques and refine design direction
- Establish and promote design guidelines, best practices, and standards
- Conceptualize and execute creative for organic/paid content & campaigns of varying scale and complexity for the app products, PR & Brand
- Maintain accuracy and attention to detail throughout the creative and production process
- Collaborate with cross-functional teams comprising interaction designers, content writers and product managers
Technical Expertise
- Knowledge of Colour Theory, Visual Hierarchy, Typography, Colour, and Information Composition
- Proficiency in Adobe Suite especially Photoshop and Illustrator
- Be able to design eye-catching branding, iconography, and illustrations
- Be able to work in a cross-functional team as well as independently
- Up-to-date with the latest visual trends, techniques, and technologies
- Must be comfortable with a fast-paced environment
- BS/MS in Visual Design, Graphic Design, Communication Design is a plus
Overview:
We are looking for Test Engineers to work on quality assurance of software applications using the Open API ecosystem for reputed Financial and Insurance companies. This candidate should be experienced in executing manual and automated testing tools and processes.
Responsibilities:
- Review requirements, specifications and design documents to provide business & customer experience feedback
- Create and maintain well-structured test plans, test cases and defects using tools like JIRA and QC
- Design, develop and execute automation scripts using opensource tools like PostMan and Rest-Assured
- Test native and responsive mobile applications
Requirements:
- Experience of 2 - 5 years in Functional and Automation testing
- Experience in working with automation tools like Selenium, TestNG, Automation tools - BDD (Cucumber)
- Experience working in an Agile/Scrum development process and QA methodologies
- Experience in testing of mobile native and responsive design apps
- Hands on experience on automated testing tools alike TestArchitect, MockIt and Rest-Assured
- Hands-on experience with both white box and black box testing
- Experience with performance and/or security testing will be an added advantage
RESPONSIBILITIES AND QUALIFICATIONS
Responsibilities
+ Design, build and maintain low latency, high-performance electronic trading platform components, with a focus on market data, exchange and client connectivity and risk controls.
+ Deliver continuous optimization for latency, scale and resiliency improvements.
+ Participate in system builds for various markets globally, have curiosity and interest in understanding market microstructure details, work closely with engineering, sales and product teams globally for successful delivery of projects.
+ Basic Qualifications
+ Bachelors or Masters degree in computer science or engineering or equivalent experience
+ 5+ years of professional experience developing deterministic high performance, low latency systems in python/C++ (counted in single digit microseconds)
+ Prior experience with FIX and binary exchange connectivity and market data protocols preferred
+ Strong knowledge of object oriented programming, data structures, algorithms and design patterns
+ Critical path analysis, performance optimization and hardware acceleration.
+ Linux systems programming experience including memory management, concurrent programming infrastructure, and the networking stack
+ Experience developing distributed architecture systems and messaging protocols
+ Strong analytical and problem solving skills
+ Comfortable in a fast-paced environment, self-motivated, results driven and commercially focused
Preferred Qualifications
+ Software development in python/C++ in the context of high performance (low- latency, high-throughput) real-time computing.
+ Familiarity with STL and C++11 language extensions, Boost
+ Network programming (sockets, TCP/UDP/Multicast protocols)
+ Multi-threading, concurrent programming
+ Intimate knowledge of compilers, flow of data at hardware level (memory/ caches, buses) + Some experience with FPGA or other hardware acceleration technologies
+ Experience processing large static datasets as well as high volume ticking data sources
+ Over 3 years' experience in Financial industry (Plus)
Company: Lincode Labs
Responsibilities:
Establish and maintain a deep understanding of the overall product portfolio and the competitive landscape. Lead technical discovery and prepare/deliver technical presentations explaining our products to prospects and customers. Create and deliver powerful presentations and demos to clients that clearly communicate the uniqueness of the value proposition. Successfully manage and execute technical proof of concepts (POCs), on-site or remote. Responsible for representing the product to customers and at field events such as conferences, seminars, etc. Evangelize Lincode products to prospects, customers, and partners via presentations and product demos. Convey feature input and customer requirements to Product Management teams. Partnering with sales executives to plan, prepare and execute on strategic deals in complex sales cycles. Collaborate with sales teams to understand customer requirements and provide sales support. Respond to technical objections and articulate the value and return on investment delivered. Liaise with the Engineering, Product, Marketing, and Sales teams to provide consultative technical expertise for all customer needs. Effectively communicate & build confidence with customers across teams (Engineering, Product, Marketing, and Sales). Engage in and oversee the development of customer proposals, design and delivery, ensuring all expertise, information and recommendations are concisely defined
Requirements:
2-3 years Sales Engineering experience. Worked previously with Machine Learning/ Computer Vision Companies- preferred Min qualification- Graduates Knowledge about installing Industrial cameras Excellent presentation, written and verbal communication skills to communicate professionally. Self motivated with strong interpersonal and problem-solving skills. Ability to work well in a highly dynamic team.











