- Big data developer with 8+ years of professional IT experience with expertise in Hadoop ecosystem components in ingestion, Data modeling, querying, processing, storage, analysis, Data Integration and Implementing enterprise level systems spanning Big Data.
- A skilled developer with strong problem solving, debugging and analytical capabilities, who actively engages in understanding customer requirements.
- Expertise in Apache Hadoop ecosystem components like Spark, Hadoop Distributed File Systems(HDFS), HiveMapReduce, Hive, Sqoop, HBase, Zookeeper, YARN, Flume, Pig, Nifi, Scala and Oozie.
- Hands on experience in creating real - time data streaming solutions using Apache Spark core, Spark SQL & DataFrames, Kafka, Spark streaming and Apache Storm.
- Excellent knowledge of Hadoop architecture and daemons of Hadoop clusters, which include Name node,Data node, Resource manager, Node Manager and Job history server.
- Worked on both Cloudera and Horton works in Hadoop Distributions. Experience in managing Hadoop clustersusing Cloudera Manager tool.
- Well versed in installation, Configuration, Managing of Big Data and underlying infrastructure of Hadoop Cluster.
- Hands on experience in coding MapReduce/Yarn Programs using Java, Scala and Python for analyzing Big Data.
- Exposure to Cloudera development environment and management using Cloudera Manager.
- Extensively worked on Spark using Scala on cluster for computational (analytics), installed it on top of Hadoop performed advanced analytical application by making use of Spark with Hive and SQL/Oracle .
- Implemented Spark using PYTHON and utilizing Data frames and Spark SQL API for faster processing of data and handled importing data from different data sources into HDFS using Sqoop and performing transformations using Hive, MapReduce and then loading data into HDFS.
- Used Spark Data Frames API over Cloudera platform to perform analytics on Hive data.
- Hands on experience in MLlib from Spark which are used for predictive intelligence, customer segmentation and for smooth maintenance in Spark streaming.
- Experience in using Flume to load log files into HDFS and Oozie for workflow design and scheduling.
- Experience in optimizing MapReduce jobs to use HDFS efficiently by using various compression mechanisms.
- Working on creating data pipeline for different events of ingestion, aggregation, and load consumer response data into Hive external tables in HDFS location to serve as feed for tableau dashboards.
- Hands on experience in using Sqoop to import data into HDFS from RDBMS and vice-versa.
- In-depth Understanding of Oozie to schedule all Hive/Sqoop/HBase jobs.
- Hands on expertise in real time analytics with Apache Spark.
- Experience in converting Hive/SQL queries into RDD transformations using Apache Spark, Scala and Python.
- Extensive experience in working with different ETL tool environments like SSIS, Informatica and reporting tool environments like SQL Server Reporting Services (SSRS).
- Experience in Microsoft cloud and setting cluster in Amazon EC2 & S3 including the automation of setting & extending the clusters in AWS Amazon cloud.
- Extensively worked on Spark using Python on cluster for computational (analytics), installed it on top of Hadoop performed advanced analytical application by making use of Spark with Hive and SQL.
- Strong experience and knowledge of real time data analytics using Spark Streaming, Kafka and Flume.
- Knowledge in installation, configuration, supporting and managing Hadoop Clusters using Apache, Cloudera (CDH3, CDH4) distributions and on Amazon web services (AWS).
- Experienced in writing Ad Hoc queries using Cloudera Impala, also used Impala analytical functions.
- Experience in creating Data frames using PySpark and performing operation on the Data frames using Python.
- In depth understanding/knowledge of Hadoop Architecture and various components such as HDFS and MapReduce Programming Paradigm, High Availability and YARN architecture.
- Establishing multiple connections to different Redshift clusters (Bank Prod, Card Prod, SBBDA Cluster) and provide the access for pulling the information we need for analysis.
- Generated various kinds of knowledge reports using Power BI based on Business specification.
- Developed interactive Tableau dashboards to provide a clear understanding of industry specific KPIs using quick filters and parameters to handle them more efficiently.
- Well Experience in projects using JIRA, Testing, Maven and Jenkins build tools.
- Experienced in designing, built, and deploying and utilizing almost all the AWS stack (Including EC2, S3,), focusing on high-availability, fault tolerance, and auto-scaling.
- Good experience with use-case development, with Software methodologies like Agile and Waterfall.
- Working knowledge of Amazon's Elastic Cloud Compute( EC2 ) infrastructure for computational tasks and Simple Storage Service ( S3 ) as Storage mechanism.
- Good working experience in importing data using Sqoop, SFTP from various sources like RDMS, Teradata, Mainframes, Oracle, Netezza to HDFS and performed transformations on it using Hive, Pig and Spark .
- Extensive experience in Text Analytics, developing different Statistical Machine Learning solutions to various business problems and generating data visualizations using Python and R.
- Proficient in NoSQL databases including HBase, Cassandra, MongoDB and its integration with Hadoop cluster.
- Hands on experience in Hadoop Big data technology working on MapReduce, Pig, Hive as Analysis tool, Sqoop and Flume data import/export tools.
About Molecular Connections
About
Connect with the team
Similar jobs
Job description
A medical representative promotes and sells pharmaceutical products to healthcare specialists, such as doctors and pharmacists. They provide information about various products' benefits, usage and dosage, to increase product awareness and sales.
Role: Field Sales Executive
Industry Type: Pharmaceutical & Life Sciences
Department: Sales & Business Development
Employment Type: Full Time, Permanent
Role Category: Retail & B2C Sales
Education
UG: Any Graduate
Key Skills
Commercial awareness. Presentation skills. Research skills. Resilience. The ability to negotiate and collaborate. Patience. Strong interpersonal and communication skills. Organizational skills.
Founded in 2016, they are one of the leading online scheduling software companies in the world, with over 200,000 customers globally. They are a profitable, high-growth bootstrapped platform-as-a-product company with 50+ team members looking to grow to $50M in revenue in the next 3 years.
Role: SSE- Backend [Golang]
Location: Remote (India)
CTC: 22-26 LPA
NP: 30 days or less
Note: Other Backend Language /Frameworks like Python, NodeJS and Java Springboot and willingness to learn Golang can also be considered
Skillset Requirements:
- Strong experience with backend programming languages and technologies like
- Golang (minimum 2-year experience)
- Protobuf and gRPC
- RESTful APIs
- Docker and Kubernetes
- Medium-level experience with PostgreSQL and MySQL database concepts.
- Ability to write efficient, secure, well-documented, and clean code.
- Proven ability to work with multiple teams, multitask and prioritize.
- Experience with Git, JIRA, and Agile working methodology.
- Experience with design patterns, Event-Driven architecture, and Domain Driven Designs.
Responsibilities:
- Write code that meets standard and delivery guidelines.
- Mentor fellow engineers in the team to develop high-quality software and perform code
reviews.
- Work with the team to break user stories into tasks and delegate them to the team
members.
- Playing a key role in architectural and design decisions, building toward an efficient
microservices distributed architecture.
- Analyze solutions and help implement engineering best practices.
- Work with Project Managers for timely delivery and forecast.
- Lead and mentor junior engineers on technical issues. Perform blameless RCAs when
issues occur and take ownership to resolve issues.
#remotejobs #bootstrapped #platformasaproduct #highgrowth
Minimum Qualifications
- Excellent problem-solving skills and the got right attitude to work in fast paced environments
- Bachelor’s degree in computer science or equivalent practical experience
- 2 to 5 years of experience in software development using modern frontend frameworks in JavaScript/TypeScript.
- Strong understanding of data structures and algorithms.
Preferred Qualifications
- Strong in Object Oriented Programming and Design Patterns.
- You have experience of working closely with the product and design teams to deliver the product that materially impacts the business and improves the customer experience
- You follow SOLID principles and have experience with microservice architecture, have designed and implemented high performance scalable services/APIs.
- You have experience with component based architectures, PWA, Service workers, UI patterns and libraries most preferably ReactJS / NextJS
- Write client side high performant applications & develop prototypes
- Experience working with Node, NestJS / Express.
- Experience working with PostgreSQL, Redshift, Dynamo, Mongo and Cassandra databases.
- Experience working with RabbitMQ, Kafka.
- You constantly learn and adopt best practices at work, keeping in mind app performance, security, and scalability.
- You have experience working in distributed systems and built/designed systems to failover, event streaming, caching strategies
- You have experience with Docker/Kubernetes in AWS or any cloud computing platforms. And, are familiar with CI/CD processes.
Bonus if you are great communication and team collaboration skills.
Number Theory is looking for experienced software/data engineer who would be focused on owning and rearchitecting dynamic pricing engineering systems
Job Responsibilities:
Evaluate and recommend Big Data technology stack best suited for NT AI at scale Platform
and other products
Lead the team for defining proper Big Data Architecture Design.
Design and implement features on NT AI at scale platform using Spark and other Hadoop
Stack components.
Drive significant technology initiatives end to end and across multiple layers of architecture
Provides strong technical leadership in adopting and contributing to open source technologies related to Big Data across multiple engagements
Designing /architecting complex, highly available, distributed, failsafe compute systems dealing with considerable scalable amount of data
Identify and work upon incorporating Non-functional requirements into the solution (Performance, scalability, monitoring etc.)
Requirements:
A successful candidate with 8+ years of experience in the role of implementation of a highend software product.
Provides technical leadership in Big Data space (Spark and Hadoop Stack like Map/Reduc,
HDFS, Hive, HBase, Flume, Sqoop etc. NoSQL stores like Cassandra, HBase etc) across
Engagements and contributes to open-source Big Data technologies.
Rich hands on in Spark and worked on Spark at a larger scale.
Visualize and evangelize next generation infrastructure in Big Data space (Batch, Near
Real-time, Realtime technologies).
Passionate for continuous learning, experimenting, applying and contributing towards
cutting edge open-source technologies and software paradigms
Expert-level proficiency in Java and Scala.
Strong understanding and experience in distributed computing frameworks, particularly
Apache Hadoop2.0 (YARN; MR & HDFS) and associated technologies one or more of Hive,
Sqoop, Avro, Flume, Oozie, Zookeeper, etc.Hands-on experience with Apache Spark and its
components (Streaming, SQL, MLLib)
Operating knowledge of cloud computing platforms (AWS,Azure) –
Good to have:
Operating knowledge of different enterprise hadoop distribution (C) –
Good Knowledge of Design Patterns
Experience working within a Linux computing environment, and use of command line tools
including knowledge of shell/Python scripting for automating common tasks.
Role: Full Stack Web Developer (full time, remote)
Job description:
Ycenter is looking for a Full Stack Developer to join its Digital Innovations and product development team. This is a fully remote, full time position. You will be employed under the Ycenter India office.
We’re looking for a dynamic coder and problem-solver to work with our Digital Innovations team and help build web products that solve complex global problems for our clients. Preferably a Full Stack Developer / Software Engineer with 2-4 years of experience in building & maintaining web applications, not afraid of taking on new challenges in a fast paced startup environment, able to take leadership decisions independently (read: without a boss) and an obsession for effective & timely communication.
Why you should work with us:
- If you’ve ever felt that technology should be used for social good, or wanted to create measurable impact through your work, this is the opportunity
- Be a part of a global team of engineers, entrepreneurs, researchers, designers, and a bot to tackle complex business & social problems for our clients. Past clients include Abbott Global Healthcare, US Department of Commerce, GODAN (Global Open Data For Agriculture & Nutrition), Microsoft and United Nations.
- Work directly with Ycenter’s leadership team and grab optional opportunities to learn Design Thinking, Leadership and Entrepreneurship (read: what makes a startup successful. We will tell you from experience)
- Work on end-to-end projects that add real value to your portfolio.
- We care about you as a person and the work you do, more than spreadsheets and corporate KPIs. In fact if you love spreadsheets, this role is not for you.
- We are obsessed about pop culture, good movies, TV shows, books and music. We will probably judge you by your Netflix Watch History more than your CV.
Responsibilities:
- Build end-to-end web applications and test for performance based on predefined scope.
- Work with Ycenter's leadership team to integrate business requirements with technical architecture and understand the product development roadmap.
- Analyze & optimize user metrics, system performance and database security.
- Work with Ycenter’s leadership team to conduct user research and design UX/UI.
- Optimize search engine performance.
- Maintain third-party API integrations & help automate client business processes.
Skills & technologies:
- Should be proficient in at least one object oriented programming language: C++ / Java / Python / JavaScript
- Skilled at and experienced in web application development with the following full-stack competency:
- Preferred stack: MERN (MongoDB, ExpressJS, React, NodeJS)
Alternate stack: LAMP with Laravel framework - Should be familiar with building Progressive Web Applications using custom service workers for offline functionality
- Experience with offline storage, threading, and performance tuning
- Proficient in frontend development using HTML5, CSS3, JavaScript, JQuery, JSON
- Knowledge of Javascript-based data visualization & graph libraries
- Knowledge of and experience in server-side scripting and process automation
- Knowledge of and experience in MySQL database operations & optimization.
- Knowledge of and experience in building & handling REST APIs
- Knowledge of and experience in server environment setup & application deployment in either AWS or Microsoft Azure
- Knowledge of building Python-based applications is a bonus but not a requirement
- Should have experience with UI/UX design
- Should be familiar with the Git version control system.
- Should be experienced in application testing (manual) and CI/CD workflow
- Should be comfortable working with DevOps processes using Agile methodology
Position – Principal Architect
Location – Bangalore/Mumbai/Remote
About Us
upGrad is an online education platform building the careers of tomorrow by offering the most industry-relevant programs in an immersive learning experience. Our mission is to create a new digital-first learning experience to deliver tangible career impact to individuals at scale. upGrad currently offers programs in Data Science, Machine Learning, Product Management, Digital Marketing, and Entrepreneurship, etc.
upGrad is looking for people passionate about management and education to help design learning programs for working professionals to stay sharp and stay relevant and help build the careers of tomorrow.
- upGrad was awarded the https://iamaiida.in/index.php">Best Tech for Education by IAMAI for 2018-19
- upGrad was also ranked as one of the https://www.linkedin.com/pulse/linkedin-top-startups-2018-25-most-sought-after-india-linkedin/">LinkedIn Top Startups 2018: The 25 most sought-after startups in India
- upGrad was earlier selected as one of the https://www.fastcompany.com/most-innovative-companies/2017/sectors/india">top ten most innovative companies in India by FastCompany.
- We were also https://www.ft.com/content/9150579a-f24c-11e6-95ee-f14e55513608">covered by the Financial Times along with other disruptors in Ed-Tech
- upGrad is the https://yourstory.com/2017/01/startup-india-learning-program-offers-free-online-entrepreneurship-course/">official education partner for Government of India - Startup India program
- Our program with IIIT B has been ranked https://www.analyticsindiamag.com/top-10-courses-and-training-programs-on-artificial-intelligence-in-india-ranking-2018/">#1 program in the country in the domain of Artificial Intelligence and Machine Learning
About the Role
A highly motivated individual who has experience in architecting end to end web based ecommerce/online/SaaS products and systems; bringing them to production quickly and with high quality. Able to understand expected business results and map architecture to drive business forward. Passionate about building world class solutions.
Role and Responsibilities
- Work with Product Managers and Business to understand business/product requirements and vision.
- Provide a clear architectural vision in line with business and product vision.
- Lead a team of architects, developers, and data engineers to provide platform services to other engineering teams.
- Provide architectural oversight to engineering teams across the organization.
- Hands on design and development of platform services and features owned by self - this is a hands-on coding role.
- Define guidelines for best practices covering design, unit testing, secure coding etc.
- Ensure quality by reviewing design, code, test plans, load test plans etc. as appropriate.
- Work closely with the QA and Support teams to track quality and proactively identify improvement opportunities.
- Work closely with DevOps and IT to ensure highly secure and cost optimized operations in the cloud.
- Grow technical skills in the team - identify skill gaps with plans to address them, participate in hiring, mentor other architects and engineers.
- Support other engineers in resolving complex technical issues as a go-to person.
Skills/Experience
- 12+ years of experience in design and development of ecommerce scale systems and highly scalable SaaS or enterprise products.
- Extensive experience in developing extensible and scalable web applications with
- Java, Spring Boot, Go
- Web Services - REST, OAuth, OData
- Database/Caching - MySQL, Cassandra, MongoDB, Memcached/Redis
- Queue/Broker services - RabbitMQ/Kafka
- Microservices architecture via Docker on AWS or Azure.
- Experience with web front end technologies - HTML5, CSS3, JavaScript libraries and frameworks such as jQuery, AngularJS, React, Vue.js, Bootstrap etc.
- Extensive experience with cloud based architectures and how to optimize design for cost.
- Expert level understanding of secure application design practices and a working understanding of cloud infrastructure security.
- Experience with CI/CD processes and design for testability.
- Experience working with big data technologies such as Spark/Storm/Hadoop/Data Lake Architectures is a big plus.
- Action and result-oriented problem-solver who works well both independently and as part of a team; able to foster and develop others' ideas as well as his/her own.
- Ability to organize, prioritize and schedule a high workload and multiple parallel projects efficiently.
- Excellent verbal and written communication with stakeholders in a matrixed environment.
- Long term experience with at least one product from inception to completion and evolution of the product over multiple years.
Qualification
B.Tech/MCA (IT/Computer Science) from a premier institution (IIT/NIT/BITS) and/or a US Master's degree in Computer Science.
Years of Exp – 14+
- Perform technical feasibility studies of new technologies and architectures, including evaluation of OTS cloud offering.
- Generate entire software image for the target device, including the kernel, device drivers, libraries, and application software, and the bootloader for proprietary IOT connectivity device(s).
- Software packaging with RPM building and management
- Define the process to upgrade the new Linux package to existing hardware at customer premises
- Configuration and Troubleshoot of the proprietary IOT connectivity devices for internal R&D teams during their development and verification
- Automate the creation and distribution of keys and certificates
- Understand, implement, and automate security controls for IoT connectivity devices.
- Tune server and application-level performance monitoring and alerting.
- Help define our roadmap and architecture based on technology and business needs, considering architectural issues and tradeoffs
- Understand and manage integration points with other systems that interface with your applications
- Supports development of project plans, including scope, budget, schedules, and risk management.
- Works closely with the business analysts, software development and verification team, the functional manager, and the program manager.
- Collaborate and work with global teams in multiple locations.
- Interface with Global Privacy and Security team for the IoT Gateway understand security risks and recommendations and provide solutions to mitigate the security risks
- Bachelor’s degree in Computer Networking / Computer Science / Software Engineering or a related field
- 12+ years of hands-on experience in Networking, shell scripting, and Linux internals, with a development background.
- Strong understanding of Networking concepts like VPC, Route tables, Host base router firewall, SSH, NAT, DNS, DHCP, SNMP, Virtual IPs, VPN
- Linux System Administration and Networking work experience
- Configuring Firewalls(IP tables/firewall) and security software
- Able to generate Linux packages, and configure based on business needs.
- Passion for cybersecurity. Ability to build secured Linux packages with antivirus and security patches.
- Shell, Python scripting experience
- Basic SQL skills
- Ability to work with cross-functional and remote teams. Must be able to communicate in English, both written and verbal.
- Interpersonal skills to effectively collaborate with vendors and customers.
- Experience with Agile Scrum
- Development background in Java/C++
- DevOps knowledge
- Knowledge on javascript
Ours is a scalable microservices platform and geospatially-aware applications across multiple industries and form-factors. In this role, you must be able to multitask, quickly
adapt to new development environments, learn new systems, create reliable/maintainable
code, and find creative and scalable solutions to difficult and complex problems. You take
pride and ownership in your work as well as the overall contributions of your team. You must also have the ability to take a system-wide understanding, recognize use of system
components and disparate technologies and be able to diagnose and debug components
across an entire system. Your ability to communicate clearly and concisely (both written and verbal) is key, as is being a self-starter.
Primary Responsibilities:
● Build, train, mentor and lead a cross-functional agile team
● Help design, architect and develop advanced software solutions supporting multiple
projects and initiatives in a dynamic agile environment
● Collaborate with product owners and/or the business on requirements definition,
development of functional specifications, and design
● Wok in close collaboration with Scrum masters, Technical Product Manager and
Stakeholders within the team and function to co-own the deliverables
● Collaborate on or lead development of technical design and specifications as required
● Establish and lead best practices in software engineering
● Mentor and grow new employees on your team
● End to end feature development with a team size of 8-10 Dev & QA engineers across
levels.
Requirements:
● Bachelor’s Degree required, preferably in Computer Science or related field
● 10+ years of software development experience using both Frontend and Backend
technologies like - React.js/Angular.js, along with GoLang/Java/Python, or another object-oriented programming language
● 3+ years as an engineering lead or manager
● Experience with cloud technologies (AWS) and containerization (Docker/EKS) and Microservices
● Experience with SAFe Agile is preferred
Note: Role is full stack with more inclination to backend side.