In light of the recent COVID-19 pandemic - OPTASY would like to offer DRUPAL website support for any Health Care, Government, Education and Non-Profit Organization(s) with critical crisis communication websites or organizations directly providing relief. Stay Safe and Stay Well.

How to Scale Your Node.js App: Best Strategies and Built-In Tools for Scalability 

How to Scale Your Node.js App: Best Strategies and Built-In Tools for Scalability 

by RADU SIMILEANU on May 03 2018

Whether it's the increasingly challenging workload or you simply want to enhance your Node.js app's tolerance to failure and availability, there comes a time when you just need to scale it up, right? To “squeeze” the best performance out of your entire infrastructure of... nodes. Well then, here's how to scale your Node.js app:

And scaling up your web back-end app at different levels —  overall improving its throughout — sure isn't an afterthought with Node.js:

Scalability is built in the very core of the runtime.

And the infrastructure of nodes, strategically distributed, communicating with each other, is what makes this framework particularly scalable.

So, what is the best way to scale up your Node.js app?

Which are the most powerful built-in tools for scalability to explore and to “exploit”? And what are the best strategies to go for depending on your specific scenario and scalable architecture needs?

 

Horizontally Scaling Your Node.js App 

Horizontal scaling comes down to... duplicating:

Basically, you duplicate your application instance, enabling it to “cope with” a larger number of incoming connections.

Note: you can horizontally scale your Node.js app either across different machines or on a single multi-core machine.

A word of caution: do keep in mind, though, that this scaling solution might add up unnecessary complexity to your app's infrastructure; it might entail the need to provision and to maintain a load balancer, might make troubleshooting more challenging, and even change the way you deploy your app.

That being said: make sure that it's specifically this Node.js scaling solution that your project needs before you go ahead and implement it!

 

Vertical Scaling

If your scalability architecture needs involve nothing more than:

 

  1. injecting more power 
  2. adding more memory

     

with no particular “tweaking” applied to the code, then vertical scaling might just be the right answer to the “how to scale your Node.js app” dilemma.

Here's why:

 

  • by default, Node won't use more than 1.76GB of 64-bit machines' memory
  • in case of a 32GB of RAM machine, for instance, the Node process will limit itself to only a fraction of its memory

     

Have Multiple Processes Running on The Same Machine

Here's another possible answer to your “How to Scale your Node.js app” question:

Have multiple processes running on the same port.

It goes without saying that this scaling solution calls for some kind of internal load balancing that would distribute the incoming connections across the entire ecosystem of cores/processes.

Word of caution!

Not sure whether there's any need to add this: keep the number of running processes lower than that of the cores!

Hereinafter, let's focus on 2 Node.js built-in tools for scalability that you might want to tap into:

 

The Cluster Module 

Node's cluster module makes a great starter for scaling up your application on a single machine.

How does it work precisely?

It makes setting up child processes sharing server ports conveniently easy. 

Practically, one “master” process will be in charge with spawning all the child processes (and there's one “worker” for each core), those that actually run your Node.js app.

Feel free to dig here into more details on the whole process. 

Yet, there are certain limitations to this basic scaling solution:

 

  1. in case one of your child processes “dies”, it doesn't... regenerate itself
  2. you'll need to handle the master-worker processes difference... the “old school way”, using an “if-else” block
  3. there's no way of modifying multiple processes, at once, on-the-fly!

     

Note: yet, when it comes to the “dead child processes” drawback, there's... hope. For instance, use this piece of code that would enable the master process to... respawn the “worker”:

cluster.on('exit', (worker, code, signal) => {
 cluster.fork();
});

And voila! This drawback has been taken off your list! 

 

The PM2 Cluster Module

Using the PM2 cluster module, “how to scale your Node.js app” dilemma turns into:

“Lay back and let the PM2... clusterfy your server for you!”

All you need to do is “trigger” this command's superpower:

pm2 start app.js -i 4 –name="api"

It will instantly create a 4-node cluster for you!

Now, here are some more details about what's going on “under the hood” during this process:

 

  1. the PM2 daemon will take over the ex “master process'” role and spawn N processes (the former “worker processes”) while relying on round-robin balancing
  2. moreover, if it's PM2 process manager that you're using, your process gets automatically scaled across all the existing cores (no need to trigger the cluster module for that anymore)
  3. also, the same PM2 process manager will ensure that processes restart, instantly, if they happen to crash

     

You'll just need to write your Node.js app as if it were for single-core usage and the PM2 module will make sure that it gets scaled for multi-core.

Note: now if you want to scale your Node.js application further, you might want to consider deploying more machines... 

 

Scaling Across Multiple Machines with Network Load Balancing

The underlying process is more than similar to the “multiple core scaling” one, if you come to think of it:

Instead of several cores, you'll have several machines; each one will be running one or more processes and will get “backed up” by a load balancer redirecting traffic to each machine in this infrastructure.

“And how does a network balancer work, more precisely?” you might ask yourself:

Once a request is sent to a node, the balancer sends the traffic to a specific process.

And there are 2 ways of deploying your internal balancer:

 

  1. deploy a machine and set up a network balancer yourself, using NGINX
  2. use a managed load balancer (like Elastic Load Balancer); setting it up is conveniently easy and it “spoils” you with all kinds of built-in features, such as auto-scaling

     

Now if your “How to scale your Node.js app” question turns into a “Isn't it risky to have just one point of failure for my infrastructure?":

Just deploy multiple load balancers instead of relying on a single balancer. 

They would be all pointing to the same servers, needless to add.

Note: for distributing traffic across your “ecosystem” of internal balancers, you could just add several DNS “A” records to your main domain.

 

How to Scale Your Node.js App: 3 Scaling Strategies to Consider

1. Decomposing

“Microservice” is another word for this scaling strategy. For practically you'll be “juggling” with multiple microservices (although their size is of no significant importance, actually).

Or multiple applications, with different codebases (and in many cases, each one of them has its own UI and dedicated database).

And it's by services and functionalities that you'll be decomposing/scaling your Node.js app. A strategy that can lead to unexpected issues in the long run, but which, if implemented correctly, translates into clear gains for your apps' performance.

 

2. Splitting

Or “horizontal partitioning” or “sharding”, if you prefer. This strategy involves splitting your app into multiple instances, each one responsible for a single, specific part of your app's data!

Word of caution: data partitioning calls for a lookup before you carry out each operation; this way you'll identify the right instance of the application to be used.

Take this example here:

You might want to partition your Node.js app's users by language or area of interest. In this case, a lookup step is a must; you'll need to check that information, first things first.

 

3. Cloning

And this is the easiest strategy at hand for solving your “How to scale your Node.js app” dilemma!

Just clone your Node.js back-end application, multiple times, and assign a specific part of the workload to each cloned instance!

It's both effective and cost-effective!

Moreover, Node's cluster module makes cloning on a single server ideally easy to implement!

And this is “How to scale your Node.js app”! See? You have not just one, but several Node.js built-in tools at hand and various strategies to choose from, depending on your scaling needs.

Which scaling solution suits you/your app project best?

Development

We do Web development

Go to our Web development page!

Visit page!

Recommended Stories

10 Best Headless CMS in 2020, That Cover Most of Your Requirements (Part 1)
Overwhelmed with options? Are you building your first (e-commerce) headless CMS and you don't know what headless CMS platform to choose?  What are the best headless CMS in 2020, so you can at least narrow down your choices and start... somewhere? Which system matches most of your feature requirements? Here's a top 10: 1. But First: What Is a Headless CMS, More Precisely? Relax, I won't bore you with too many details — we already have an in-depth post on the differences between headless and traditional CMS. So, if we were to sum up the concept in just a few words, we could say that: A headless content management system is an architecture where content is separated from the presentation layer (the client-side front-end). Meaning that you get to create, store, and edit "raw" content (with no design or layout) in the backend and deliver it wherever needed —wearable, mobile app, website — via API. In short, what you get in a headless architecture is: a database to store your content in a dashboard for editing your content Source: Zesty.io As for the "head" that serves your content to the end-user : you're free to build your own front-end, from the ground up … and even multiple front-ends, if needed, that will all use calls from the API to retrieve and display content 2. … Then What's a Decoupled CMS? Headless CMS vs decoupled CMS: what's the difference? And why headless over decoupled? The role that the API plays… That's what makes the difference (and why you'd want to go for a headless approach): If, in a decoupled architecture, the API plays the role of an intermediary between back-end and front end, in a headless architecture the API can be used by any of the front-end portions for pulling data. In other words, a decoupled CMS does come with a built-in front-end delivery layer, that you can rely on, but a headless approach is an API-driven content repository. Which gives you more flexibility for delivering content to any type of display layer. … to multiple "heads". You're free to distribute it wherever it needs to get displayed. 3. Why Choose a Headless CMS? Top 9 Benefits Before I "divulge" the best headless CMS in 2020 to you, here's a shortlist of the key advantages of using a headless CMS software: you get to engage your customers with personalized content across an entire network of digital channels, at different stages in their journey you can deliver richer digital experience, tailored to each channel you gain platform independence you're free to choose your technology of choice you benefit from cross-platform support you get to manage your content from a central location and distribute it to multiple platforms/IoT-connected devices, in a universal format you're free to manage all your platforms from one interface your development team gets to choose the development framework of their choice, integrate new technologies and, overall… innovate you're free to redesign as often as you need to, without the dread of re-implementing your entire CMS from the ground up     4. … And When Should You Use It? 5 Best Use Cases  How do you know for sure that you need to adopt this approach? You know it because your scenario describes one of the following use cases for headless CMS: you're building a site using a technology you're familiar with you're building a website with a static site generator you're building a JS-based website or web app you're building a native mobile app you're building an e-commerce site and you know that the commerce platform you're using won't… cut the mustard as a CMS; or you need to enrich product info in your online store 5. What Are the Best Headless CMS in 2020? Top 10 "Which CMS should I use?" you wonder. "The one that meets most of your requirements…" So, you should start by pinning them down. What features are you looking for in a CMS? Maybe you need a system that should: be straightforward and easy to use for the marketers/non-technical people in your team be built on… Node be highly customizable and editable for your content team to be able to change overlay text, logo, background video/image be simple to set up integrate easily with Gatsby support multi-site setups not be tied up to (just) one specific database provide ease of content entry and rich-text support provide a granular permission system provide native support for content types What are the features that your project couldn't live without? Now, with that list of "mandatory" features at hand, just drill down through your top headless CMS options in 2020. Here they are: 5.1. Storyblok A purely headless CMS that ships with a visual editor, as well. Why would you go for Storyblok? What makes it one of the best headless CMS in 2020? it provides the experience of a page builder for all those non-technical users in your team: editors get to manage content via a more user-friendly interface it grants your developers easy access to the APIs they need 5.2. Prismic Its major selling point? It allows you to choose your own language, framework, technology… And these are the 3 good reasons to go with Prismic as your headless CMS: it allows you to model your content schema and to add your content you're free to choose whatever framework that meets your feature needs: React, Vue, Next, Nuxt, Node, Gatsby… you're free to choose either GraphQL or RESTful API to query content 5.3. Drupal 8 Headless CMS   Another great option is to exploit Drupal's headless capabilities and pair them with the JavaScript framework of your choice. Here are some of the best reasons why you'd use a Drupal 8 API-first architecture: Drupal's a mature and enterprise-level headless solution backed by a wide community, used by more than 1 million sites globally; you get to tap into its massive module collection and even create new custom ones to extend your website's functionality its JSON:API follows the JSON:API specification; developers in your team can start using the API even if they're not experts in working with Drupal you get to load your GraphQl schemas straight from your Drupal content repository; there's a specialized module for this: the GraphQL module you get to use all of  Drupal's famed features (granular access to content, processes, workflows, modules, etc.) right away; you get them out-of-the-box since the REST API is… rooted deep into Drupal 5.4. Strapi, One of the Best headless CMS for Gatsby. It's an open-source Node.js headless CMS, a "host it yourself" one, that allows you to build Node.js apps in… minutes. Why would you use it? because it generates available RESTful API or uses GraphQL shortly after installation, making data available via customizable API because it allows your developers to invest all their resources in writing reusable app logic (instead of having to use some of that time to build an infrastructure) because it's fully JavaScript because it supports plugins that extend the platform's functionality because it's open-source: you'll find the entire codebase on GitHub  5.5. Contentful  Looking for a platform-agnostic solution? A… content delivery network that would enable your development team to manage and distribute (and reuse) content to multiple channels? Then this is the API-driven headless CMS you're looking for. Here are 6 other reasons why you'd want to put Contentful on your shortlist: consistent APIs easy to set up you're free to create your own models easy to use: ships with a robust, non-technical, user-friendly UI you get to add custom plugins quick and easy you get to set your own schemas to get displayed the way you want them to, across different apps Good to know! There's even a Shopify extension available. What it does is connect your online store to your content, stored in Contentful. And if you'll need help with building, fine-tuning, and integrating your content hub, we're ready to tweak Contentful to your needs.  END of Part 1! Stay tuned, for there are 5 more candidates for the title of "the best headless CMS in 2020" waiting in line.  Image by Couleur from Pixabay ... Read more
Adriana Cacoveanu / Sep 25'2020
Why Use Node.js with React? 11 Reasons Why You Should Hook Up Your React App with a Node Back-end
So, you’d like to build an app with React. And, while weighing your back-end options, you ask yourself: “Why use Node.js with React?” Why would you go with Node for hosting and running your web server? Why not… Ruby on Rails? Or maybe Python/Django? This is precisely what you’ll find in this post: the 11 main reasons why you’d want to choose Node.js as a backend for your React web app: 1. But First: What Is the Difference Between ReactJS and Node.js? We already have a blog post focused precisely on the React vs Node dilemma, so in today’s post I’ll only pinpoint, briefly, the main differences between the 2 technologies:   While ReactJS is a front-end library, Node.js is a highly popular choice for back-end development (thanks to its event-driven nature and to being asynchronous and highly scalable)   While React provides you with a language to describe the user interface of your web application, Node.js helps you with all sorts of (back-end) things like setting up your server, building CLI tools, scripting; a key difference to help you solve your “React vs Node.js” dilemma   While ReacJS helps you build your UI components, Node.js stores your app’s data in the backend   While React is web app developers’ top choice to address challenges like low performance and slow user interface, Node.js is the go-to technology for creating enterprise-level solutions based on WebSockets, event quests, and microservice architecture. 2. Does ReactJS (Really) Require Node?  In other words, do you need to have a Node.js backend to run React? No, you don’t. Node.js is not required for running Reactjs. So, why use Node.js with React? There are certain use cases and reasons why you’d want to pair the 2 technologies for building your app: you cut down on your web app development time (which always has a major business impact) the Node.js and React duo is your ticket to scalable and efficient code … But more on the strongest reasons why you’d use Reactjs with Node down below... 3. Why Use Node.js with React? 11 Top Reasons Now, going back to your initial question — “Why do you need Node.js for React?” — here are the key reasons why you’d go with this “duo”: 3.1. Because they’re both JavaScript: you can execute them server-side and client-side The benefits you get from having a JS-based technology in the back-end, as well, are obvious: you only need to be familiar with JavaScript (no Ruby or Python expertise needed) same language means… same packages same language means that you get to speed up your app’s development process 3.2. Because you get to inject V8 engine performance into your React app In other words, your React app will be perfectly equipped to handle bulk requests with no compromise on quality. The V8 engine that Node.js uses grants your app the best page load times. 3.3. Because you get a collection of NPM packages to choose from With the NPM CLI at your disposal, you get to install any of the packages available in the registry quick and easy. 3.4. Why use Node.js with React? Because the “duo” helps you address high server load issues  They work perfectly together to help your app handle multiple client requests while striking a server load balance. 3.5. Because Node.js bundles your app into a single, easy-to-compile file Using various modules along with Webpack, Node Js bundles your app into one file. One that can get compiled much easier... 3.6. Because it’s a real-time, data-intensive React app that you’re building. Does your React application depend on Data Streaming or Data-Intensive, Real-Time management? Is interactivity a major requirement for your web app? Is it a real time application that you have in mind? Then Nodejs makes the best choice for continued server connection in a context of intensive computation. 3.7. Because you get to run React.js code straight in the Nodejs environment 3.8. Because you get to scale your React & Node.js app to much higher loads A Node.js back-end will help your app accommodate many more users and many more future calls.  It's your best option for building scalable applications. The 2 giants are using Node.js precisely for its great scalability potential. 3.9. Because you get to build JSON APIs for your app much easier when using Node and React together How come? You get to share and reuse code in React.js quick and easy when you pair it with Node.js in the back-end. 3.10. Because rendering server-side becomes a more streamlined process Since React DOM comes with components built to work with Nodejs out of the box, you get to cut down on the lines of code.  Which translates into streamlined server-side rendering.   3.11. Because it’s a single-page React app that you’re building The “React with Node.js” duo makes the best choice for building a SPA. The lightweight Node backend will be in charge of handling asynchronous data loading via callback functions. 4. In Short, You’d Want to Use React and Node.js Together Because... “Why use Node.js with React?” As a conclusion, we could narrow down the entire list to just 2 key reasons:   Convenience: same language in the back-end and the front-end; Node.js makes the go-to option for running and hosting a web server for your React app   ReactJS depends on Node and npm (Node Package Manager) to notify the native side (iOS/Android) of the packages that you need to use in your app; then, it can add all the needed dependencies. The END! Now that you know why and when you’d want to use React with Node.js: how do you build that high-performance, conveniently scalable React & Node.js app? We’re here to help you get the most of these 2 technologies. Just drop us a line to have a team of React and Node Js developers handle your project. Image by Anemone123 from Pixabay ... Read more
Adriana Cacoveanu / Sep 16'2020
Create React App vs Next.js: Which One Should You Go With for Building Your Next App?
You're about to start working on a new app project and you're confused: Create React App vs Next.js - what's the difference?  Which option's best for you? Considering your SEO,  SSR, API, and performance needs. And they're frustratingly similar: they both enable you to build React apps without the need to use Webpack for bundling it (or the need to do any code splitting) they both make it possible for you to have your React app up and running in no time Still, each framework comes with its own pros and cons and specific use cases. So, in this post, you'll find your answers to the following questions: What are the key differences between CRA and Next.js? What are the main benefits of using Next.js? What are the main benefits of using Create React App? What are the downsides of Next.js? What are the downsides of Create React App? When would you want to use one over the other? 1. What's the Key Difference Between CRA and Next.js? SSR vs CSR... It's where all their differences stem from. Next.js apps are rendered on the client-side (CSR), but the framework supports server-side rendering (SSR), as well. By comparison, Create React App apps are rendered only on the client-side. In other words: CRA generates HTML code in the client browser, whereas Next.js generates it in the server, based on the URL.  So, your "Create react App vs Next.js" dilemma comes down to whether a static page meets your needs or not entirely. 2. What Are the Main Benefits of Using Next.js? Now that you know what's the fundamental difference between the 2 systems for building React apps, let's put the spotlight on Next.js. Why would you choose it? because it's so simple to set up, build, and even host a Next.js app: you have packages for almost all the key additions that call for Webpack configuration (SaSS, CSS, TS...) because rendering React apps becomes much easier, regardless of where the data comes from because you can benefit from automatic server rendering and code splitting (that will increase performance) because SSR (server-side rendering) will give your app a major performance boost  because it's a lightweight framework for both static and server-rendered universal JS apps because it's good for SEO (with everything being generated from the server...) 3. Create React App vs Next.js: What Are the Main Benefits of Using CRA? In a "Next.js vs create-react-app" debate, what are the strongest reasons for opting for CRA to build your React app? it's easier to deploy you get to build a single page React app with... zero configuration (no time-consuming setup needed) you don't need to deal with Webpack or Babel it's plain simple (an empty div and just a few js files) and provides all the needed HTML code to render your app on the client-side  the development process is much smoother better developer experience In short, with Create React App you basically run just one command and the framework sets up all the tools you need to start developing your app on the spot. 4. What Are the Downsides of Next.js? What could make you think twice before choosing Next.js for building your next app? the fact that it's opinionated: there's a Next.js way of doing things and you're constrained to... adjust to it if you later want to use a router different from its own filled-based one (or add Redux maybe), you'll discover that it's not that flexible  5. What Are the Downsides of Create React App? In a "Create React App vs Next.js" debate, why would you rule out CRA? because it only supports client-side rendering, which is not enough if it's a high-performing app that you want to build because no code splitting translates into lower performance because it's not good for SEO (since it doesn't render pages on the server) 6. When Would You Want to Use Next.js? As a rule of thumb, use Next.js: if you need to build a fast, production-ready app (SSR injects top speed into your React application) if public SEO is a crucial factor for your app project if it's a dynamic page that you need to create (wihout having to write your own bundling) if it's an eCommerce app that you're building (Next.js is more suited for the cart, the stock inventory, and other highly dynamic pages) 7. When Would You Want to Use Create React App? When would you choose it over Next.js? when you need to build a React app really fast; with CRA you can skip the configuration and the setting up part when you need to create a landing page for a product: Create React App makes it so much simpler to put it together when it's a SPA that you need to build 8. In Conclusion... CRA is easy, while Next.js "seduces" you with better performance and SEO. Is it a single page React app that you need to get up and running fast and you don't need SSR? Create React App might just be the best choice for you. Is it a fast-loading app that you're building? Is performance business-critical for you and SEO much more than just a nice-to-have? You might want to consider Next.js then for your next app. Need a team of experienced app developers to build it for you? Just send us your feature list and... let's build it! Image by Pexels from Pixabay   ... Read more
Silviu Serdaru / Aug 07'2020