For many years you began to look for the "virtualization" of computers, that is, having the possibility of using different "virtual" computers within the same physical computer. It is done with software that simulates having more than one computing environment with its operating system, programs, processes, and files. 

Docker containers: Docker is an open-source software platform where you can create "containers", the simple definition of a lighter virtual machine, which means it is less demanding on the resources of the physical computer where they run. This has been especially useful for developers who want to test or use their applications in any environment. 

1 Virtualization: From what you can see, both virtual machines and Docker containers provide separate environments for running programmes. The two are fundamentally different in the way that they encourage this isolation.

2 Consistency: A virtual machine is separate from the host operating system since it runs on its operating system. A VM can therefore run on any operating system. On the other hand, a Docker container works with any Linux distribution. Running Docker on a Windows computer or an older Mac could provide some issues.

3 A Docker image is small and often only a few kilobytes in size: A virtual machine instance can be several gigabytes or terabytes. Performance Docker containers offer performance that is nearly as good as native. They start in a few milliseconds since they are lightweight. A virtual machine (VM) can be started like a standalone device on your computer. A VM instance can begin in a few minutes or longer.

4 Safety: Docker Operating Systems containers use the host operating system. Therefore, the Docker containers are also vulnerable to security flaws if the host OS is. On the other hand, virtual computers are more secure because they start up using their operating system. Remember that every virtual machine is an absolute machine running inside another. Consider using a virtual machine if you must meet strict security requirements for sensitive applications.

How to Install Apache Spark?

Standalone mode

It is the simplest way to install Apache Spark because it only requires downloading an instance or a compiled version and adding it to each cluster node.

Spark over Mesos

Mesos is a resource manager that will take care of task distribution. In this installation, you would have your driver or main, which will set up your SparkContext, and the cluster manager or Mesos, which will be in charge of distributing the tasks in the different Worker Nodes, which are the other machines in your cluster.

Spark over YARN

Like the previous mode, you would have YARN as a resource manager, which is also inside Apache Hadoop and is the one in charge of the MapReduce processes. It is the most common installation.

What is Kubernetes?

Kubernetes is a portable, flexible Open-Source platform that supports declarative setup and automation for managing containerized workloads and services. It has a vast, expanding ecosystem. Services, assistance, and tools for Kubernetes are widely accessible.

The Cloud Native Computing Foundation (CNCF), a division of the Linux Foundation, Install Kubernetes On Centos 7 for maintaining it. Google, RedHat, CoreOS, IBM, Microsoft, Mesosphere, VMWare, HP, and a list of other corporation