We are looking for an outstanding Big Data Engineer with experience setting up and maintaining Data Warehouse and Data Lakes for an Organization. This role would closely collaborate with the Data Science team and assist the team build and deploy machine learning and deep learning models on big data analytics platforms.
Roles and Responsibilities:
- Develop and maintain scalable data pipelines and build out new integrations and processes required for optimal extraction, transformation, and loading of data from a wide variety of data sources using 'Big Data' technologies.
- Develop programs in Scala and Python as part of data cleaning and processing.
- Assemble large, complex data sets that meet functional / non-functional business requirements and fostering data-driven decision making across the organization.
- Responsible to design and develop distributed, high volume, high velocity multi-threaded event processing systems.
- Implement processes and systems to validate data, monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
- Perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Provide high operational excellence guaranteeing high availability and platform stability.
- Closely collaborate with the Data Science team and assist the team build and deploy machine learning and deep learning models on big data analytics platforms.
Skills:
- Experience with Big Data pipeline, Big Data analytics, Data warehousing.
- Experience with SQL/No-SQL, schema design and dimensional data modeling.
- Strong understanding of Hadoop Architecture, HDFS ecosystem and eexperience with Big Data technology stack such as HBase, Hadoop, Hive, MapReduce.
- Experience in designing systems that process structured as well as unstructured data at large scale.
- Experience in AWS/Spark/Java/Scala/Python development.
- Should have Strong skills in PySpark (Python & SPARK). Ability to create, manage and manipulate Spark Dataframes. Expertise in Spark query tuning and performance optimization.
- Experience in developing efficient software code/frameworks for multiple use cases leveraging Python and big data technologies.
- Prior exposure to streaming data sources such as Kafka.
- Should have knowledge on Shell Scripting and Python scripting.
- High proficiency in database skills (e.g., Complex SQL), for data preparation, cleaning, and data wrangling/munging, with the ability to write advanced queries and create stored procedures.
- Experience with NoSQL databases such as Cassandra / MongoDB.
- Solid experience in all phases of Software Development Lifecycle - plan, design, develop, test, release, maintain and support, decommission.
- Experience with DevOps tools (GitHub, Travis CI, and JIRA) and methodologies (Lean, Agile, Scrum, Test Driven Development).
- Experience building and deploying applications on on-premise and cloud-based infrastructure.
- Having a good understanding of machine learning landscape and concepts.
Qualifications and Experience:
Engineering and post graduate candidates, preferably in Computer Science, from premier institutions with proven work experience as a Big Data Engineer or a similar role for 3-5 years.
Certifications:
Good to have at least one of the Certifications listed here:
AZ 900 - Azure Fundamentals
DP 200, DP 201, DP 203, AZ 204 - Data Engineering
AZ 400 - Devops Certification

About netmedscom
About
Connect with the team
Similar jobs
Office Assistant:
- Back office administration and support personnel
- Good organizational skills
- These tasks may include, proofreading, providing support service to the team, data entry
- Multitasking & Clerical work
About UpSolve
Working on new tech solutions around Image, Video and NLP. At UpSolve we focus on making AI available and affordable for all at scale.
Job Description:
The selected candidate will be responsible for the ideation, development, and execution of mobile and web apps.
Freshers, please DO NOT apply.
Job Responsibilities:
- Advise on the design of iOS, Android and Web apps
- Develop entire applications using Flutter, Android Studio or other platforms.
- Build Web apps in python backend using Flask or Django.
- Communicate and collaborate with different teams regularly.
Job Requirements:
- Experienced in publishing iOS and Android applications
- Experience in building futter applications and compiling using Xcode
- Bachelor's/Master's degree in Engineering, Computer Science (or equivalent experience)
- 3+ years of experience in full-stack development
- Should possess a portfolio of code or apps for review
- Must be a critical thinker and provide effective and efficient solutions
Location: Mumbai
Work Mode: Work from Office
Job Responsibilities
✓ Perform the role of Technical Lead on assigned projects to drive solution design (especially backend) and API services development.
✓ Be the thought leader and champion for above mentioned technologies.
✓ Drive technical analysis for new projects including planning and driving proof-of-concepts, if needed.
✓ Drive tasks related to backend development by providing architectural and technical leadership to mid-tier and database developers.
✓ Conduct peer reviews as the lead into Git to confirmed that developed code meets acceptable standards and guidelines.
✓ Work closely with the rest of the leads, mid-tier development, front-end developers, database developers, etc. to ensure end-to-end integrity of the solution being developed.
✓ Work closely with the rest of the tech leads and senior engineering leadership team to ensure reuse where applicable to increase productivity and throughput.
✓ Conduct technical interview to staff open positions in the backend team.
✓ Delegate work and assignments to team members
✓ Collaborate with their team to identify and fix technical problems
✓ Analyze users' needs and then finding applications to serve them
✓ Drive assigned tasks related to SOC 2 certification and ensure compliance to defined controls for areas under lead’s purview.
✓ Guiding their team through technical issues and challenges
✓ Prepare Technical design documents which would help the team to understand the technical flow
✓ Active participation in customer calls especially discussions related to Technical/Architectural and provide inputs.
Required Experience:
✓ Backend Lead around 14 years of experience
✓ Server less Computing Architecture
✓ NodeJS, MySQL, Jenkins, Python, GitLab Technologies
✓ Good knowledge of AWS Cloud
✓ Full cycle AWS implementation experience
✓ Project experience in development and maintenance support for AWS web service and Cloudbased implementations
✓ Experience leading teams of up to 10 + professionals
Ability to manage multiple tasks and projects in a fast-moving environment
Educational Qualifications:
Engineering graduate or B. Tech/MCA with relevant major subjects like Computer Science
● Developing user-facing features using ReactJS and Redux
● Building reusable components and front-end libraries for future use
● Translating wireframes and mockups intto high-quality code
● Optimizing components for maximum performance across a vast array of web-capable
devices and browsers
● Contribute to all phases of the development lifecycle.
● Write well designed, testable, efficient code.
● Support continuous improvement by investigating alternatives and technologies and
presenting these for architectural review.
● Work in an Agile model, maintaining and following the Sprint cycles, plans and ensure
product quality.
Skills and Qualifications:
● Thorough understanding and experience of Angular 5/6/7 and its core principles
● Strong proficiency in JavaScript, including DOM manipulation and the JavaScript
object model
● Familiarity with newer specifications of ECMAScript (preferably ES6) API.
● Understanding of CSS box model.
● Experience in writing modular and maintainable code.
● Experience with data structure libraries (e.g., Immutable.js)
● Experience with RESTful APIs
● Knowledge of modern authorization mechanisms, such as JSON Web Token
● Familiarity with modern front-end build pipelines and tools
● Experience with front-end development tools such as Babel, Webpack, NPM, etc.
● Ability to understand and translate business requirements into technical requirements
● A knack for benchmarking and optimization
● Familiarity with code versioning tools (such as Git, SVN, and Mercurial)
Job Description - UI Developer
● Experience with popular React.js workflows (such as Flux or Redux) is good to have
● Good and Effective communication Skills
Graphic Designer - Marketing/comms
Opportunity
Create marketing material for our growth initiatives, social media platforms, and branding collaterals. The ideal candidate should have an eye for clean, simple, and artful visual design. A successful candidate will be able to translate high-level requirements into visual elements that align with the language of our products.
What you will do:
- Develop out-of-the-box campaigns for Social Media channels (Facebook, Twitter, Instagram, YouTube).
- Conceptualize original graphic design ideas that bring simplicity and user-friendliness to complex roadblocks.
- Present concepts, participate in design/project critiques and refine design direction.
- Establish and promote design guidelines, best practices, and standards.
- Conceptualize and execute creative for organic/paid content & campaigns of varying scale and complexity for the app products, PR & Brand.
- Maintain accuracy and attention to detail throughout the creative and production process.
- Collaborate with cross-functional teams comprising interaction designers, content writers and product managers.
Experience Range:
Proven 3-4 years of work experience as a Graphic Designer. Must have worked on digital marketing creatives. Having worked in the app product space is a huge plus.
Technical Expertise:
- Demonstrable graphic design skills with a strong portfolio.
- Knowledge of Color Theory, Visual Hierarchy, Typography, Colour, and Information Composition.
- Proficiency in Adobe Suite especially Photoshop and Illustrator.
- Be able to design eye-catching branding, iconography, and illustrations.
- Be able to work in a cross-functional team as well as independently.
- Up-to-date with the latest visual trends, techniques, and technologies.
- Must be comfortable with a fast-paced environment
- BS/MS in Visual Design, Graphic Design, Communication Design is a plus.
Designing user interactions on web pages.
Developing back-end website applications.
Creating servers and databases for functionality.
Ensuring cross-platform optimization for mobile phones.
Ensuring responsiveness of applications.
Working alongside graphic designers for web design features.
Seeing through a project from conception to finished product.
Designing and developing APIs.
Meeting both technical and consumer needs.
Staying abreast of developments in web applications and programming languages.
Pioneered over the last 25 years by an eminent professor at Harvard Business School, this independent body effectively conducts indigenous research, offers academic and executive courses, extends advisory services to the Government and corporates as well as organises various events. It studies competitiveness of nations, regions and cities and generates suitable guidelines for business ventures and those in governance. It indeed offers unique and relevant solutions for socio-economic problems.
What you will do:
- Understanding the competitive landscape within each market
- Proposing research studies that will lead to impactful business decisions
- Developing and establishing a well-defined roadmap before starting a research project
- Working hand-in-hand with the business in understanding the various market, economic or such questions which are to be answered through relevant research
- Designing the research methodology and also identifying and locating relevant information related to the particular research
- Identifying various data sources, collecting and analyzing data relevant to the research topic and also supporting in report-writing
- Performing statistical and qualitative analysis of data related to markets and competitors
- Planning and implementing project research processes and methodologies
- Monitoring the project output, analyzing the final conclusion and utility of the same in line with the business needs
Desired Candidate Profile
What you need to have:
- Masters in Economics or Public Policy is a must
- Excellent communication skills and exceptional attention to details
- Ability to gather relevant data from various sources
- Strong problem-solving skills
- Strong quantitative and qualitative analysis skills
We are looking for an AngularJS engineer to build world-class user
experience while innovating with and implementing full front-end stack. We
need someone who thinks outside the box, someone who doesn't settle on one solution, and someone who loves challenging projects and complex user flow and advance technologies.
Work Profile
o Delivering a complete front end application in AgularJS
o Ensuring high performance on mobile and browser with reusable and modular components spanning cross multiple projects
o Coordinating the workflow between the graphic designer, the HTML coder, and yourself
o Integrate with the back-end developer in the process of building the RESTful API o Communicating with external web services for 3rd Party tools and services integration
Requirement
o 3+ years of experience and proficiency with AngularJS, JavaScript and HTML5
o Deep knowledge of AngularJS practices and commonly used modules based on extensive work experience
o Creating self-contained, reusable, and testable modules and components
o Ability to provide SEO solutions and optimization
o Writing non-blocking code, and resorting to advanced techniques such as multi-threading, when needed
o Creating custom, general use modules, and components which extend the elements and modules of core AngularJS
Location- Ahmedabad
PriceLabs (https://www.chicagobusiness.com/innovators/what-if-you-could-adjust-prices-meet-demand" target="_blank">chicagobusiness.com/innovators/what-if-you-could-adjust-prices-meet-demand) is a cloud based software for vacation and short term rentals to help them dynamically manage prices just the way large hotels and airlines do! Our mission is to help small businesses in the travel and tourism industry by giving them access to advanced analytical systems that are often restricted to large companies.
We're looking for someone with strong analytical capabilities who wants to understand how our current architecture and algorithms work, and help us design and develop long lasting solutions to address those. Depending on the needs of the day, the role will come with a good mix of team-work, following our best practices, introducing us to industry best practices, independent thinking, and ownership of your work.
Responsibilities:
- Design, develop and enhance our pricing algorithms to enable new capabilities.
- Process, analyze, model, and visualize findings from our market level supply and demand data.
- Build and enhance internal and customer facing dashboards to better track metrics and trends that help customers use PriceLabs in a better way.
- Take ownership of product ideas and design discussions.
- Occasional travel to conferences to interact with prospective users and partners, and learn where the industry is headed.
Requirements:
- Bachelors, Masters or Ph. D. in Operations Research, Industrial Engineering, Statistics, Computer Science or other quantitative/engineering fields.
- Strong understanding of analysis of algorithms, data structures and statistics.
- Solid programming experience. Including being able to quickly prototype an idea and test it out.
- Strong communication skills, including the ability and willingness to explain complicated algorithms and concepts in simple terms.
- Experience with relational databases and strong knowledge of SQL.
- Experience building data heavy analytical models in the travel industry.
- Experience in the vacation rental industry.
- Experience developing dynamic pricing models.
- Prior experience working at a fast paced environment.
- Willingness to wear many hats.
- Integration of user-facing elements developed by front-end developers
- Build efficient, testable, and reusable PHP modules
- Solve complex performance problems and architectural challenges
- Integration of data storage solutions.
- Maintaining social media and admin panel accounts.
Skills And Qualifications
- Strong knowledge of PHP web frameworks.
- Understanding the fully synchronous behavior of PHP
- Understanding of MVC design patterns
- Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3
- Knowledge of object-oriented PHP programming
- Understanding accessibility and security compliance.
- Strong knowledge of the common PHP or web server exploits and their solutions
- Understanding fundamental design principles behind a scalable application
- User authentication and authorization between multiple systems, servers, and environments
- Integration of multiple data sources and databases into one system
- Familiarity with limitations of PHP as a platform and its workarounds
- Creating database schemas that represent and support business processes
- Familiarity with SQL/NoSQL databases and their declarative query languages
- Proficient understanding of code versioning tools, such as Git.
- Website development and API integrations. Database and password security.









