\nProblems and Issues?

If you get any kind of error, have doubts or would like to suggest modifications, go to this handbook repo in GitHub and open an issue describing what you mean.

Go to Backend Handbook in GitHub

",{"_177":178,"_43":44,"_47":48,"_45":46,"_65":66,"_179":180,"_204":175},"previewContent","

\n Introduction\n
- \n Objective\n
\n
\n About the Author\n
\n Setup\n
- \n Linode\n
\n
\n Dependencies\n
- \n Remember # and $ symbols\n
- \n Library Essentials\n
- \n Database Systems and Datastores\n
- \n Web Servers and App Servers\n
- \n Libraries\n
\n
\n Configure Tools\n
- \n Jenkins\n
- \n Vagrant\n
\n
\n Brew World\n
- \n Homebrew\n
- \n Install X with Brew\n
- \n Relevant Links\n
\n
\n Additional Resources\n
- \n Books\n
- \n Guides\n
- \n Links & Resources\n
\n
\n Problems and Issues?\n

\n\n\n

\nIntroduction

\n\n

My very first intensive Ubuntu servers experience was back then in year 2014. The company had hosted 20+ Drupal websites in a dedicated server in hosting provider. As you should know, dedicated machines are expensive. One day, my boss in that company told me:

\n\n

\n
Frank, we need to start saving money. I think we can save a lot if we move all sites to basic Linode VPS.\nIf you’re able to move all those websites to Linode before [GIVEN DATE], the amount of dollars in the hosting service bill\nwill be yours.
\n

\n\n

Then, to buy me in, he said:

\n\n

\n
I rather give you that money than to the hosting provider.
\n

\n\n

I was in.

\n\n

After the first two migrated websites, everything went very good and real quick, though it was a real pain in the ass. The whole migration, in general terms, consisted of:

\n\n

In the hosting provider:

\n\n

Backing up the MySQL database for the Drupal website
Zipping the website files in a tar format
Downloading the zip

\n\n

In my local environment:

\n\n

Create a new db and import the exported data
Unzip the zipped file in the adequate folder
Check everything was in order

\n\n

Doing the process local helped a lot because I used Vagrant to replicate an Ubuntu server. Every step done locally was replicated, almost exactly, in the server.

\n\n

When everything local was completed, I’d move to the next steps.

\n\n

In Linode:

\n\n

Launch a new basic Ubuntu server VPS
Create all necessary server records(A, TXT, CNAME)

\n\n

In the Linode server:

\n\n

Setup a new system user
Setup the new user SSH login
Harden the server\n
- Setup firewall rules
- Deactivate root login
- Set an SSH port greater than 10000
\n
Install required software
Configure software
Create folder structure
Upload zip file
Upload database backup
Unzip file and place files in given folder
Import database data
Create Apache virtual host

\n\n

After everything was loading correctly in a subdomain, the original domain would point to the Linode nameservers and I’d checked it was loading as it should. Then moved on to the next website.

\n\n

Yes, they were lots of steps for 20+ websites. None of those steps were automatized and back then I didn’t know how to automat them.

\n\n

Fortunately, I finished on time and got USD 500 in my bank account. However, I told myself I wouldn’t do that kind of manual work again. I set to learn Bash scripting and ways to automate everything I could as much as it would be possible.

\n\n

From that day on I got into the Ops world. I created scripts for doing a kind of deploy of Drupal websites and kept trying and doing more scripts for several things I saw were very repetitive and could be automated. One thing took me to another and learnt even more about Bash, also learnt Ansible, Terraform, Docker, Jenkins.

\n\n

I took every chance I had to try and learn new tools to make my life as a developer a bit easier and now all that knowledge is in this handbook.

\n\n

\nObjective

\n\n

This handbook main objective is to help you get started in the process of setting up and configure Ubuntu servers(from 14.04+) to host Ruby on Rails apps. Born from doing several configurations for previous Ruby on Rails applications, many sections described in this handbook can be used for many other type of web apps.

\n\n

The Backend Handbook contains information to configure development tools such as Vagrant or Jenkins. Also covers how to setup servers like the ones you get in services like in Digital Ocean or Linode, from scratch, creating system users, and more.

\n\n

List of software installed in the process include:

\n\n

Development libraries(curl, htop, gcc, python)
PostgreSQL
RVM
Ruby
NodeJS
Redis
WKHTMLTOPDF
etc

\n\n\n

\nAbout the Author

\n\n

Francisco Quintero is a software engineer from Colombia. Although his first experiences were with Visual Basic .NET, he fell in love with web development when discovered free books(HTML, CSS, and JavaScript) published by recognized Spanish instructor Javier Eguiluz. Since then, web development is what he does and became passionated about.

\n\n\n\n\n

\nSetup

\n\n

This section will help you to get started setting up your brand new server. This process, though easy to complete, can get a wrong turn when commands are not issued carefully.

\n\n

One of the things I’ve learnt about setting up servers before writing this handbook is that computers are better than humans when automating things, so, it’s way better to have scripts and then use them as many times as we need rather than manually issuing commands in the console one by one.

\n\n\n

\nLinode

\n\n

Configurig an Ubuntu machine in Linode requires you to set it up from scratch(they give you the OS and root user). To have a working Ubuntu server you’d need to:

\n\n

Create a non-root user
Set up user SSH access
Harden SSH service configuration(change default port, etc)
Activate firewall(iptables or UFW)
More…

\n\n

\nCreate New non-root user

\n\n

A non-root user is a system user that can log in to the server but in order to run superuser commands needs to precede them with sudo and inputing her password.

\n\n

\nAdd a user

\n\n

\n
NOTE: the # symbol denotes the commands are run as root user, not as a system user.\nNOTE: the $ symbol denotes the commands are run as a system user.
\n

\n\n

1 # adduser [USERNAME]\n

\n\n\n\n

Example:

\n\n

1 # adduser deployer\n

\n\n\n\n

Give that user permissions to run sudo commands

\n\n

1 # usermod -a -G sudo [USERNAME]\n

\n\n\n\n

Example:

\n\n

1 # usermod -a -G sudo deployer\n

\n\n\n\n

\nReferences

\n\n

You can always see the man pages for previous commands to learn more about them or reading their docs online.

\n\n

1 $ man adduser\n2 $ man usermod\n

\n\n\n\n

Online documentation:

\n\n

adduser
usermod

\n\n

\nSet up User SSH Access

\n\n

In order to access a Linode machine from your development computer(or any other machine) you need an SSH key that identifies that user on the server. Using SSH authentication is recomended, and certainly, more secure than password authentication.

\n\n

\nGenerate a New SSH Key

\n\n

Using a computer with Linux or macOS:

\n\n

1 $ ssh-keygen -b 4096\n

\n\n\n\n

\n
When generating ssh keys, the prompt will ask you to enter a passphrase. That is a secret word to further protect your key. I, normally, don’t assign any to my ssh keys for server access.
\n

\n\n

Follow the steps in the console prompt and take note of where the generated keys(they come in pair) are located in your computer.

\n\n

Now, login into the server (via password access) and create a .ssh folder in the user’s home folder and then give all permissions only to the owner:

\n\n

1 $ ssh [USERNAME]@[SERVER-IP-ADDRESS]\n2 $ mkdir -p ~/.ssh && chmod -R 700 ~/.ssh\n

\n\n\n\n

Back in your computer, proceed to upload the generated ssh key. In the folder you generated the keys should be placed two files: id_rsa and id_rsa.pub. We are going to upload the public key (id_rsa.pub).

\n\n

\n
In the ssh key generation prompt you can give any other name to the keys. I usually name them according to the project I’m working on.
\n

\n\n

Upload the file using the scp command. It has the syntax scp ORIGIN DESTINATION

\n\n

1 $ scp /path/to/file [USERNAME]@[IP-ADDRESS]:~/\n

\n\n\n\n

Example:

\n\n

1 $ scp /home/cesc/id_rsa.pub ubuntu@167.34.56.18:~/\n

\n\n\n\n

Finally, login once again into the server and move the id_rsa.pub key into the authorized_keys file that is read by the SSH service.

\n\n

1 $ ssh [USERNAME]@[SERVER-IP-ADDRESS]\n2 $ mv id_rsa.pub .ssh/authorized_keys\n

\n\n\n\n

\nReferences

\n\n

See man pages for more details in the previously used commands.

\n\n

1 $ man ssh\n2 $ man ssh-keygen\n3 $ man scp\n

\n\n\n\n

Online docs:

\n\n

ssh
ssh-keygen
scp

\n\n

\nHarden SSH Service from Configuration File

\n\n

Leaving the default configuration for the ssh service is not recommendable because it leaves your server open to attacks from intruders or anyone with the intention of breaking your machine.

\n\n

By modifying some settings in the sshd_config file your server will be more secured though not impenetrable, but something is better than nothing.

\n\n

The sshd_config is located (in Ubuntu 14.04) at /etc/ssh/sshd_config. The next commands suppose you are editing that file.

\n\n

\nOpen the Configuration File

\n\n

1 $ sudo nano /etc/ssh/sshd_config\n

\n\n\n\n

\n
Following settings is how the file settings should look. If you find them this way, it is all ok.
\n\n
If you are using nano editor you can find lines in a file using the CTRL + W key combination and typing the desire word.
\n

\n\n

\nChange the Default Port

\n\n

1 Port [PORT-NUMBER]\n

\n\n\n\n

\n
22 is the default. Change to a 5 digit number, like 12781, to make it more secure.
\n

\n\n

\nDeactive Root Access

\n\n

1 PermitRootLogin no\n

\n\n\n\n

\nDeactivate Password Access

\n\n

1 PasswordAuthentication no\n

\n\n\n\n

\nRestart SSH Service Configuration

\n\n

Exit the nano editor with CTRL + O (save changes) & CTRL + X.

\n\n

1 $ sudo service ssh restart\n

\n\n\n\n

\nReferences

\n\n

In the man pages, as always.

\n\n

1 $ man ssh\n

\n\n\n\n

Online docs:

\n\n

sshd_config

\n\n\n

\nDependencies

\n\n

This section includes all software a basic Ruby on Rails application would require in order to run: databases, datastores, web servers, app servers, libraries, and more.

\n\n

The list of packages or software projects described in this section was gathered from my experience working in different RoR projects. It might be very useful for several scenarios or might lack other packages for other, but regardless, it works as a good starting point.

\n\n

\nRemember # and $ symbols

\n\n

The # symbol denotes the commands are run as root user, not as a system user. In the other hand, the $ symbol denotes the commands are run as a system user.

\n\n

Examples

\n\n

Command run as root

\n\n

1 # adduser peter-griffin\n

\n\n\n\n

Command run as system user

\n\n

1 $ sudo service nginx status\n

\n\n\n\n\n

\nLibrary Essentials

\n\n

This installation makes sure the machine has the basic software the rest of the programs you’re going to install need. They provide libraries, commands or modules to those software.

\n\n

\nWhat are they for?

\n\n

Some of them are standard libraries the software that you install in your machine is going to need to work correctly.

\n\n

Others are just useful software that should be installed because some guides tells you to use them or because sooner or later you’d be needing them.

\n\n

\nHow to install them?

\n\n

Create a file $ nano install_basic_dependencies.sh and add the following content:

\n\n

 1 #!/bin/bash\n 2 \n 3 apt-get update\n 4 apt-get -y install \\\n 5   build-essential \\\n 6   curl \\\n 7   git-core \\\n 8   python-software-properties \\\n 9   htop \\\n10   vim \\\n11   libfontconfig1 \\\n12   libgmp-dev \\\n13   zlib1g-dev \\\n14   libssl-dev \\\n15   libreadline6-dev \\\n16   libyaml-dev \\\n17   libncurses5-dev \\\n18   libxml2-dev \\\n19   libxslt-dev \\\n20   libsqlite3-dev\n

\n\n\n\n

To save the file press CTRL + O and then to exit press CTRL + X.

\n\n

and run it

\n\n

1 $ sudo bash install_basic_dependencies.sh\n

\n\n\n\n

\n
NOTE\nThe list of packages to install is splited with continuation lines for readability.
\n\n
-y flag is for accepting the prompt without needing the user to type y/N
\n

\n\n

\nDocs

\n\n

See man pages for apt-get command $ man apt-get or online

\n\n\n

\nDatabase Systems and Datastores

\n\n

A database is:

\n\n

\n
A database management system (DBMS) is a computer software application that interacts with the user, other applications, and the database itself to capture and analyze data.
\n\n
Wikipedia
\n

\n\n

A datastore is:

\n\n

\n
A data store is a repository for persistently storing and managing collections of data which include not just repositories like databases, but also simpler store types such as simple files, emails etc.
\n\n
Wikipedia
\n

\n\n\n

\nPostgreSQL

\n\n

PostgreSQL is a ORDBMS(Object-Relational Database Management System).

\n\n

\nWhat is this for?

\n\n

Storing and accessing data through the Structured Query Language(SQL).

\n\n

\nHow to install it?

\n\n

Create a file $ nano install_postgresql.sh and add the following content:

\n\n

1 #!/bin/bash\n2 \n3 apt-get update\n4 apt-get -y install libpq-dev postgresql\n

\n\n\n\n

To save the file press CTRL + O and then to exit press CTRL + X.

\n\n

Then run it

\n\n

1 $ sudo bash install_postgresql.sh\n

\n\n\n\n

\nVerify

\n\n

You can check PostgreSQL is up and running by issuing $ sudo service postgresql status command in your terminal. It should return the version and port the database server is working.

\n\n

\nDocs

\n\n

A full list of PostgreSQL manuals can be found their official site.

\n\n\n

\nMySQL

\n\n

MySQL is a RDBMS(Relation Database Management System).

\n\n

\nWhat is this for?

\n\n

Storing and accessing data through the Structured Query Language(SQL).

\n\n

\nHow to install it?

\n\n

Create a file $ nano install_mysql.sh and add the following content:

\n\n

1 #!/bin/bash\n2 \n3 apt-get update\n4 apt-get -y install libmysqlclient-dev mysql-server-5.5\n5 apt-get -f install mysql-server\n

\n\n\n\n

To save the file press CTRL + O and then to exit press CTRL + X.

\n\n

Run the script

\n\n

1 $ sudo bash install_mysql.sh\n

\n\n\n\n

\nDocs

\n\n

All MySQL documentation and manuals can be found in their official page.

\n\n\n

\nRedis

\n\n

Redis is an in-memory data structure store that can be used as a database, cache and/or message broker.

\n\n

\nWhat is this for?

\n\n

Regarding Ruby on Rails applications, Redis can be used as a database for storing background jobs data. Sidekiq is a popular gem that leverages Redis to work.

\n\n

You can also use a Redis as a cache or message broker, however, solutions like RabbitMQ are better suited for this job as there have been issues about Redis losing data.

\n\n

\nHow to Install Redis

\n\n

There packages available for many operating systems that make it easy to install Redis with just a couple of commands.

\n\n

Ubuntu 14.04+

\n\n

Run the following commands:

\n\n

1 $ apt-get update\n2 $ apt-get install -y redis-server\n

\n\n\n\n

MacOS

\n\n

If you Homebrew installed just run:

\n\n

1 $ brew install redi\n

\n\n\n\n

From Source

\n\n

Create a file $ nano install_redis.hs and add the following content:

\n\n

 1 #!/bin/bash\n 2 \n 3 apt-get update\n 4 apt-get -y install tcl8.5\n 5 curl -sSL http://download.redis.io/releases/redis-stable.tar.gz -o /tmp/redis.tar.gz\n 6 mkdir -p /tmp/redis\n 7 tar -xzf /tmp/redis.tar.gz -C /tmp/redis --strip-components=1\n 8 make -C /tmp/redis\n 9 make -C /tmp/redis install\n10 echo -n | /tmp/redis/utils/install_server.sh\n11 rm -rf /tmp/redis*\n12 sysctl vm.overcommit_memory=1\n13 sed -ie 's/# bind 127.0.0.1/bind 127.0.0.1/g' /etc/redis/6379.conf\n14 service redis_6379 restart\n

\n\n\n\n

To save the file press CTRL + O and then to exit press CTRL + X, then run the instructions in the file

\n\n

1 $ sudo bash install_redis.sh\n

\n\n\n\n

and wait for redis to be installed on your machine.

\n\n

\n
NOTE\nthis way of install is called from source and the main difference between this and installing from apt-get is getting up to date packages. Sometimes the apt packages are really outdated.
\n

\n\n

\nVerify Installation

\n\n

Check redis is running with sudo service redis_6379 status. It should output something like Redis is running (PORT NUMBER).

\n\n

\nDocs

\n\n

You can find all redis documentation in its official page.

\n\n

\nWeb Servers and App Servers

\n\n

A web server is:

\n\n

\n
A web server is a computer system that processes requests via HTTP, the basic network protocol used to distribute information on the World Wide Web.
\n\n
Wikipedia
\n

\n\n

An application server is:

\n\n

\n
An application server is a software framework that provides both facilities to create web applications and a server environment to run them.
\n\n
Wikipedia
\n

\n\n\n

\nNginx Web Server

\n\n

Nginx is a web server that happens to be as well a reverse proxy, load balancer, and HTTP cache.

\n\n

\nWhat is this for?

\n\n

Using nginx you can have many things that otherwise would require you to install individual pieces of software to have a great architecture for your app:

\n\n

You can use nginx as a web server in a client-server architecture
Also works as a reverse proxy, meaning that nginx can work as first layer and send requests, according to predefined rules, to one or more backend services(Jenkins, Apache, etc)
Similar to what a reverse proxy would do, you can use nginx to work as a load balancer and distribute request to other web servers throught redirects
Nginx can also be used as a cache and you would not need to install things like Varnish, Redis or Memcache

\n\n

\nHow to install it?

\n\n

Create a file $ nano install_nginx.sh and add the following content:

\n\n

1 #!/bin/bash\n2 \n3 apt-get update\n4 apt-get -y install nginx\n

\n\n\n\n

To save the file press CTRL + O and then to exit press CTRL + X.

\n\n

Finally, run the script to install it:

\n\n

1 $ sudo bash install_nginx.sh\n

\n\n\n\n

\nVerify Installation

\n\n

If you need to verify Nginx is up, you can do it with $ sudo service nginx status.

\n\n

\nDocs

\n\n

Nginx documentation can be found here.

\n\n\n

\nPhusion Passenger

\n\n

\n
Passenger is an application server that allows you to securely operate web apps, microservices & APIs with outstanding reliability, performance and control. By acting as a process manager, reverse proxy and by providing operations tools, Passenger enables you to quickly launch and easily maintain Ruby, Node.js, Python and Meteor apps.
\n\n
Phussion Passenger
\n

\n\n

\nWhat is this for?

\n\n

Let’s try to define first what is an application server.

\n\n

In one side we have web servers which are normally used for serving static content via the HTTP protocol.

\n\n

In the other side, we got applications servers which can also do the job of a web server and do more things. The main difference(when both use no extra plugins) is that app servers can server dynamic content via the HTTP protocol or others.

\n\n

In the case of Passenger, its job is to handle business logic in applications coded in the supported languages.

\n\n

\nHow to install it?

\n\n

Create a file $ nano install_passenger.sh and add the following content:

\n\n

 1 #!/bin/bash\n 2 \n 3 apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --recv-keys 561F9B9CAC40B2F7\n 4 apt-get install -y apt-transport-https ca-certificates\n 5 \n 6 sh -c 'echo deb https://oss-binaries.phusionpassenger.com/apt/passenger trusty main \\\n 7 > /etc/apt/sources.list.d/passenger.list'\n 8 apt-get update\n 9 \n10 apt-get install -y nginx-extras passenger\n

\n\n\n\n

save the file by pressing CTRL + O and then press CTRL + X to exit it.

\n\n

Now, run the script:

\n\n

1 $ sudo bash install_passenger.sh\n

\n\n\n\n

Depending on the version of passenger you installed you either need to:

\n\n

A) uncomment lines passenger_root and passenger_ruby in /etc/nginx/nginx.conf file and then restart nginx with sudo service nginx restart.

\n\n

B) Edit /etc/nginx/nginx.conf and uncomment include /etc/nginx/passenger.conf; by removing the # character in the beginning of the line and then restart nginx with sudo service nginx restart.

\n\n

\nVerify Installation

\n\n

One of the ways to verify Passenger is working is by taking a look to the processes list and check one called watchdog is available.

\n\n

\nDocs

\n\n

See Phussion Passenger extensive documentation for more help.

\n\n\n

\nLibraries

\n\n

This section covers installation of some specific dependencies, libraries, software or stuff that some application might need.

\n\n

WKHTMLTOPDF for generating PDF files from HTML pages
Image Magick for manipulating image files
Jenkins for continuous integration
RVM(Ruby Version Manager) for managing Ruby versions
NVM(Node Version Manager) for managing Node versions

\n\n\n

\nNodeJS

\n\n

NodeJS is an open source and cross platform JavaScript runtime environment for developing server tools and/or web applications.

\n\n

\n
Although Node.js is not a JavaScript framework, many of its basic modules are written in JavaScript, and developers can write new modules in JavaScript.
\n\n
Wikipedia
\n

\n\n

\nWhat is this for?

\n\n

Because of it non-blocking and event-driven architecture real time communication applications, browser games and web applications that demand high throughput, scalability and concurrence can be designed and develop using nodejs.

\n\n

\nHow to install it?

\n\n

Create a file $ nano install_nodejs.sh and add the following content:

\n\n

1 #!/bin/bash\n2 \n3 apt-add-repository ppa:chris-lea/node.js\n4 apt-get update\n5 apt-get -y install nodejs\n

\n\n\n\n

To save the file press CTRL + O and then to exit press CTRL + X.

\n\n

Run its instructions:

\n\n

1 $ sudo bash install_nodejs.sh\n

\n\n\n\n

\nVerify Installation

\n\n

You can verify Node is installed with either $ node -v or $ node --version. The output should return a number which is the current Node version in your system.

\n\n

Additionally, you can check the installation path with $ which node or $ command -v node.

\n\n

\nDocs

\n\n

NodeJS documentation can be found in the official site

\n\n\n

\nNVM - Node Version Manager

\n\n

By using NVM you can manage(install, uninstall, use) different NodeJS versions just a few commands away.

\n\n

\nWhat is this for?

\n\n

Imagine you work in three projects where NodeJS is being used. Now, in your system you have installed Node version 8.11.1. Good, you can work all of your projects with no problem with that version… Until a dependency/colleague updates something and your current version is no longer supported.

\n\n

Now, of course you could uninstall it and install a newer one but, What if one of those projects can’t work with an updated version(greater than 8.11, in this example)?

\n\n

You could either use virtual environments with VirtualBox or Vagrant or you can use NVM to easily install and handle different NodeJS versions in your computer with not much trouble.

\n\n

\nHow to install it?

\n\n

Create a file $ nano install_nvm.sh and add the following content:

\n\n

1 #!/bin/bash\n2 \n3 curl -o- https://raw.githubusercontent.com/creationix/nvm/v0.33.11/install.sh | bash\n

\n\n\n\n

To save the file press CTRL + O and then to exit press CTRL + X, then run the file:

\n\n

1 $ bash install_nvm.sh\n

\n\n\n\n

\nVerify Install

\n\n

You can verify NVM is installed with command -v nvm or nvm or nvm --version.

\n\n

\nDocs

\n\n

See NVM GitHub project’s page for more details.

\n\n\n

\nRVM

\n\n

Easy, manage(install, uninstall, use) different ruby versions just a few commands away.

\n\n

\nWhat is this for?

\n\n

With RVM you can manage several Ruby versions easily. Without a solution like RVM(rbenv, for example) you might need to uninstall a previous Ruby version to install a differente one. Forget about it with RVM.

\n\n

Besides, you can handle gemsets to have customized and context specific ruby gems. This context can be different projects or environments.

\n\n

Most important thing about RVM is that rubies and gemsets are isolated from each other.

\n\n

\nHow to install it?

\n\n

Create a file $ nano install_rvm.sh and add the following content:

\n\n

\n
NOTE: do not run as sudo
\n

\n\n

1 #!/bin/bash\n2 \n3 gpg --keyserver hkp://keys.gnupg.net --recv-keys 409B6B1796C275462A1703113804BB82D39\\\n4 DC0E3\n5 \\curl -sSL https://get.rvm.io | bash -s stable\n

\n\n\n\n

To save the file press CTRL + O and then to exit press CTRL + X nano editor.

\n\n

Now you can run the instructions:

\n\n

1 $ bash install_rvm.sh\n

\n\n\n\n

and wait for RVM to be installed.

\n\n

Bonus: install ruby

\n\n

After installing RVM, you can proceed to install ruby:

\n\n

\n
NOTE: you should change the version of ruby for the desired one
\n

\n\n

You can run these commands one by one or place them in a file. Before create a file $ nano install_ruby.sh and add the following

\n\n

 1 #!/bin/bash\n 2 \n 3 echo \"Sourcing RVM and reloading shell\"\n 4 . /home/$(whoami)/.rvm/scripts/rvm\n 5 \n 6 echo \"RVM requirements\"\n 7 rvm requirements\n 8 \n 9 echo \"Installing ruby-2.4.1\"\n10 rvm install ruby-2.4.1\n11 \n12 echo \"Setting ruby-2.4.1 as default\"\n13 rvm --default use ruby-2.4.1\n14 \n15 echo \"Install bundler\"\n16 gem install bundler --no-document\n

\n\n\n\n

run the instructions in the file

\n\n

1 $ bash install_ruby.sh\n

\n\n\n\n

\nVerify Installation

\n\n

Check RVM is installed with $ rvm -v or $ rvm --version and the install path with $ which rvm.

\n\n

\nDocs

\n\n

Find everything about RVM in its official site

\n\n\n

\nWKHTMLTOPDF

\n\n

WKHTMLTOPDF is a command line tool for rendering HTML docs into PDF. This utility runs headless, meaning it needs no GUI to be operated or used.

\n\n

\nWhat is this for?

\n\n

Many web applications display useful information to their users. That info can be in the form of tables or well-crafted UIs, and though most of the data is not so important, there’s important info user might required in a portable format.

\n\n

A good example of important info is invoices for payments or subscriptions. The customer might want to download them to enter the info in a system they own/use or for backup purposes. Whatever the case, they’d like to export that HTML view into something they can grasp. This is when tools such as WKHTMLTOPDF can prove themselves useful.

\n\n

Be aware WKHTMLTOPDF makes sense to be used when the info is, mainly, generated from a backend because of its multiple implementations in programming languages such as Ruby.

\n\n

\nHow to install it?

\n\n

Create a file $ nano install_wkhtmltopdf.sh and add the following content:

\n\n

1 #!/bin/bash\n2 \n3 apt-get install -y openssl build-essential xorg libssl-dev xfonts-75dpi\n4 \n5 wget http://download.gna.org/wkhtmltopdf/0.12/0.12.2/wkhtmltox-0.12.2_linux-trusty-a\\\n6 md64.deb\n7 dpkg -i wkhtmltox-0.12.2_linux-trusty-amd64.deb\n

\n\n\n\n

\n
NOTE: this script installs an specific version for this library.
\n\n
You can find more versions in the downloads page
\n

\n\n

Save the file press CTRL + O and then to exit press CTRL + X. Run the file:

\n\n

1 $ sudo bash install_wkhtmltopdf.sh\n

\n\n\n\n

\nVerify Installation

\n\n

Test it is working

\n\n

1 wkhtmltopdf http://www.google.com google.pdf\n

\n\n\n\n

You should see a generated PDF file with the Google front page as content.

\n\n

\nDocs

\n\n

See complete WKHTMLTOPDF docs in the project page

\n\n\n

\nImage Magick

\n\n

Image magick is both a command line tool and a library to work and manipulate images.

\n\n

\nWhat is this for?

\n\n

When working with images in rails applications, you’re mostly going to work using carrierwave or paperclip gems. Whenever you need to crop or process images, you’re going to need to install image magick so those gems can do the processing.

\n\n

\nHow to install it?

\n\n

Create a file $ nano install_image_magick.sh and add the following content:

\n\n

 1 #!/bin/bash\n 2 \n 3 apt-get update\n 4 apt-get -y install libpng12-dev libglib2.0-dev zlib1g-dev libbz2-dev libtiff4-dev li\\\n 5 bjpeg8-dev\n 6 mkdir -p ~/image_magick_download\n 7 cd ~/image_magick_download\n 8 wget http://www.imagemagick.org/download/ImageMagick.tar.gz\n 9 tar -xzf ImageMagick.tar.gz\n10 cd ImageMagick-*\n11 sudo ./configure\n12 sudo make\n13 sudo make install\n14 sudo ldconfig /usr/local/lib\n

\n\n\n\n

To save the file press CTRL + O and then to exit press CTRL + X.

\n\n

Run the installation script

\n\n

1 $ sudo bash install_image_magick.sh\n

\n\n\n\n

\n
NOTE: this is takes a lot of time to be completed. Be patient.
\n

\n\n

\nDocs

\n\n

More documentation about image magick can be found the official site

\n\n\n

\nJenkins

\n\n

\n
Jenkins helps to automate the non-human part of the whole software development process, with now common things like continuous integration, but by further empowering teams to implement the technical part of a Continuous Delivery.
\n\n
Wikipedia
\n

\n\n

\nWhat is this for?

\n\n

As an automation tool, Jenkins is widely(but not only) for continuous integration. However, with a Jenkins basic install you can also run test suites, generate documents, and even deploy software to servers.

\n\n

Also, Jenkins is not limited to any specific software or programming language.

\n\n

Regarding RoR apps(which are the reason of this handbook), using Jenkins you could:

\n\n

run test suite when commits are sent to repository(i.e, GitHub, Bitbucket)
email specified developers in case tests break
package source code to make it deployable
with plugins or its bash integration, define deployment rules or commands
run other tasks, email developers about deployment, and more.

\n\n

\nHow to install it?

\n\n

Create a file nano install_jenkins.sh and add the following content:

\n\n

1 #!/bin/bash\n2 \n3 wget -q -O - https://pkg.jenkins.io/debian/jenkins-ci.org.key | sudo apt-key add -\n4 sh -c 'echo deb http://pkg.jenkins.io/debian-stable binary/ > /etc/apt/sources.list.\\\n5 d/jenkins.list'\n6 apt-get update\n7 apt-get -y install jenkins\n

\n\n\n\n

To save the file press CTRL + O and then to exit press CTRL + X nano. Now you can run it:

\n\n

1 $ sudo bash install_jenkins.sh\n

\n\n\n\n

See more installation options in Jenkins docs.

\n\n

\nDocs

\n\n

See Jenkins documentation in the official web site.

\n\n\n

\nConfigure Tools

\n\n

In this chapter we’ll see how to configure tools for doing backend tasks.

\n\n

Let’s see how to do it with Vagrant and Jenkins. They’re both independent tools but once we learn how they work will find out they can work together.

\n\n\n

\nJenkins

\n\n

Jenkins is an automation server that supports plugins to help in the process of building, deploying and/or automating software projects.

\n\n

A Jenkins installation can be as complex as we want it to be. Has the main advantage of being free and open source and the disadvantage is that once we install it on a server, we have to take care of everything.

\n\n

\nInitial Configuration

\n\n

Once Jenkins is installed in your system(local, Vagrant, or web server) we need to follow some steps to complete the installation and then proceed to configure it.

\n\n

In your browser go to http://localhost:8080 and wait for a Jenkins page to appear.

\n\n

The page will indicate where to find the Jenkins initial admin password.

\n\n

The file is located in /var/jenkins/secrets, so the command is:

\n\n

1 $ cat /var/jenkins/secrets/initialAdminPassword\n

\n\n\n\n

Paste the output in the input and click the Continue button at the end of the form.

\n\n

Now your Jenkins is ready to be used!

\n\n

\nSetup for the Cloud

\n\n

To access Jenkins instance installed in a EC2 machine, for example, probably you’re going to need to configure a virtual host for the web server your EC2 server uses.

\n\n

As I’m a fan of Nginx, here’s a config for nginx:

\n\n

 1 upstream app_server {\n 2   server 127.0.0.1:8080 fail_timeout=0;\n 3 }\n 4  \n 5 server {\n 6   listen 80;\n 7   listen [::]:80 default ipv6only=on;\n 8   server_name CI.YOURCOMPANY.COM;\n 9  \n10   location / {\n11     proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;        \n12     proxy_set_header Host $http_host;\n13     proxy_redirect off;\n14  \n15     if (!-f $request_filename) {\n16       proxy_pass http://app_server;\n17       break;\n18     }\n19   }\n20 }\n

\n\n\n\n

Replace CI.YOURCOMPANY.COM for your server IP address or a valid subdomain.

\n\n

\n
Checkout other configs in this gist and this other.
\n

\n\n

\nPlugins

\n\n

One of the most popular plugins in Jenkins is the GitHub one. Jenkins alone can’t do much so installing plugins is a most to take the best out of Jenkins.

\n\n

For projects hosted on GitHub, installed the respective plugin. The docs provide instructions on how to install and configure.

\n\n

One of the most important benefits of using this plugin is being able to trigger actions in Jenkins whenever a new commit is made to a given branch.

\n\n

So one could setup a job to do a deployment whenever master branch gets new commits. For this kind of setup you’d be better using a GitHub Personal Token.

\n\n

\n
Be mindful the token should have the scope admin:org_hook
\n

\n\n

\nFor Ruby on Rails

\n\n

When using Jenkins or any other CI tool to run tests for Rails apps, there’s one thing we need to be aware:

\n\n

The Jenkins server need everything your Rails app needs to run.

\n\n

Let’s say your app in development needs the following list of dependencies:

\n\n

RVM
Ruby
Bundler
A database: PostgreSQL or MySQL
NodeJS

\n\n

Then you’d have to install them all in the Jenkins server. Once they’re available you can run commands for the Rails app in the Jenkins instance:

\n\n

1 bundle install\n2 rails db:migrate\n3 rspec spec --fail-fast\n

\n\n\n\n

These commands would go in a build step. If any of those commands fail, Jenkins will notify you and you should take actions to fix them.

\n\n

\n
This article shows how to do a setup that run tests and deploys using Capistrano. It’s a bit complex but can serve as an example.
\n

\n\n

\nTips and Tricks

\n\n

Restart your Jenkins server from the a web browser with JENKINSURL/safeRestart\n
Force restart making running jobs to be lost with JENKINSURL/restart\n
In the server you can restart it with sudo service jenkins restart\n
Jenkins execution logs normally should live in /var/log/jenkins\n

\n\n

\nDocs

\n\n

Jenkins Official Docs
Jenkins Post-installation Wizard

\n\n\n

\nVagrant

\n\n

Vagrant is a tool for creating development environments with ease. Leveraging VirtualBox, you can use Vagrant to create unique and isolated development environments for almost everyting(I’ve tried PHP and RoR development environments).

\n\n

What’s best about Vagrant is that you can make these environments repeatable and portable, meaning you configure it once, use it many more times.

\n\n

In a simplified way, what Vagrant does is create a virtual machine(VM) with OS you indicate, sync the VM filesystem with its host filesystem, so that you can work as usual in your OS, i.e, Linux Mint, and run your application inside the virtual machine. This way, you can also keep your machine from being polluted with software related to an specific application.

\n\n

\nProvisioning

\n\n

Vagrant virtual machines can be provisioned with several tools:

\n\n

Shell Scripts
Ansible
Chef
Salt
Puppet
even Docker(acting as a Docker host)

\n\n

\nDocs

\n\n

Vagrant provisioning

\n\n\n

\nBrew World

\n\n

In the Linux world, we normally have tools to install software. In Debian we have dpkg, in Ubuntu distros it is apt-get, in Redhat based distros it’s yum.

\n\n

All nice but when we are given a MacBook Pro to work on in web development we don’t have any of them. Also happens that in the Mac world many software can be installed via GUI but some don’t.

\n\n

MacOS counts with MacPorts but in many articles you’ll found out that Homebrew is favoured over MacPorts. That’s why Homebrew have a section this handbook.

\n\n

\nHomebrew

\n\n

Homebrew is a package manager for the macOS operating system. It’s easy to install and use.

\n\n

To install run this script in a terminal window:

\n\n

1 $ /usr/bin/ruby -e \"$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/\\\n2 master/install)\"\n

\n\n\n\n

To verify it installed run:

\n\n

1 $ brew help\n

\n\n\n\n

\nInstall X with Brew

\n\n

Let’s see how to install some popular software using Homebrew in MacOS.

\n\n

\nRVM dependencies

\n\n

The Ruby Version Manager need many dependencies to be installed. Usually, the command rvm requirements would take care but when not you can install many of its dependencies as follows:

\n\n

1 $ brew install autoconf\n2 $ brew install automake\n3 $ brew install libtool\n4 $ brew install apple-gcc42\n5 $ brew install libyaml\n6 $ brew install libxslt\n7 $ brew install libksba\n8 $ brew install openssl\n

\n\n\n\n

\nhtop

\n\n

htop is top on stereoids. Definetely, a most for the lovers of termianl process viewers.

\n\n

To install with Brew just:

\n\n

1 $ brew install htop\n

\n\n\n\n

\nPostgreSQL

\n\n

The popular database can also be installed with Homebrew with just one command:

\n\n

1 $ brew install postgresql\n

\n\n\n\n

\nRedis

\n\n

The popular datastore for caches and more can be installed pretty easily:

\n\n

1 $ brew install redis\n

\n\n\n\n

\nWKHTMLTOPDF

\n\n

A powerful open-source software to generate PDF documents from HTML ones.

\n\n

In MacOS can be installed using Homebrew:

\n\n

1 $ brew install wkhtmltopdf\n

\n\n\n\n

\njq

\n\n

Not to be confused with the JavaScript library jQuery. jq is a software that simplifies handling JSON data in the command line.

\n\n

1 $ brew install jq\n

\n\n\n\n

It’s very powerful and in this gist you can see how I used to process some JSON from AWS Code Deploy service.

\n\n

\nPandoc

\n\n

Not so DevOps related but one of the tools I used to build this ebook is Pandoc. A very powerful, cross-platform software to generate any kind of document from any kind of document.

\n\n

In MacOS can be installed as follows:

\n\n

1 $ brew install pandoc\n

\n\n\n\n

\nRelevant Links

\n\n

\n\n\n

\nAdditional Resources

\n\n

In this section you can find hand-picked links about the DevOps culture, Linux, and related stuff. Any topic that is not fully explained will have a link here to a blog post, documentation or somewhere else you could have more detailed information.

\n\n\n

\nBooks

\n\n

Some useful books to further advance your Linux or backend tools/languages knowledge. Most of them are for free.

\n\n

Conquering the Command Line - Mark Bates
linux-insides

\n\n\n

\nGuides

\n\n

More comprenhensive and/or explained guides might be placed here.

\n\n

\n\n\n

\nLinks & Resources

\n\n

Repos, tutorials, gists, etc.

\n\n

\nLinux

\n\n

\nServer

\n\n

Server Setups

\n\n

\nOthers

\n\n

\n
CI = Continuous Integration\nCD = Continuous Delivery\nCD = Continuous Deployment
\n

\n\n

Install RVM in Vagrant

\n\n

\nConcepts

\n\n

\n\n\n\n\n

\nProblems and Issues?

\n\n

If you get any kind of error, have doubts or would like to suggest modifications, go to this handbook repo in GitHub and open an issue describing what you mean.

\n\n

Go to Backend Handbook in GitHub

\n\n

\n\n","tocStructure",[181,182,183,184,185,186,187,188,189,190,191,192,193,194,195,196,197,198,199,200,201,202,203],{"_75":76,"_43":77,"_70":-5,"_78":79,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":84,"_43":85,"_70":-5,"_78":86,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":76,"_43":91,"_70":-5,"_78":92,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":76,"_43":95,"_70":-5,"_78":96,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":84,"_43":99,"_70":-5,"_78":100,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":76,"_43":102,"_70":-5,"_78":103,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":84,"_43":106,"_70":-5,"_78":107,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":84,"_43":109,"_70":-5,"_78":110,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":84,"_43":112,"_70":-5,"_78":113,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":84,"_43":115,"_70":-5,"_78":116,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":84,"_43":118,"_70":-5,"_78":119,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":76,"_43":121,"_70":-5,"_78":122,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":84,"_43":125,"_70":-5,"_78":126,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":84,"_43":128,"_70":-5,"_78":129,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":76,"_43":131,"_70":-5,"_78":132,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":84,"_43":135,"_70":-5,"_78":136,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":84,"_43":138,"_70":-5,"_78":139,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":84,"_43":141,"_70":-5,"_78":142,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":76,"_43":144,"_70":-5,"_78":145,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":84,"_43":148,"_70":-5,"_78":149,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":84,"_43":151,"_70":-5,"_78":152,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":84,"_43":154,"_70":-5,"_78":155,"_71":80,"_87":-5,"_88":-5,"_89":-5},{"_75":76,"_43":157,"_70":-5,"_78":158,"_71":80,"_87":-5,"_88":-5,"_89":-5},"publicChapterContent","nextChapter","sections",[],"routes/_store+/_layout","routes/_store+/_readers+/_layout","actionData","errors"]

\nProblems and Issues?

Table of Contents

\nIntroduction

\nObjective

\nAbout the Author

\nSetup

\nLinode

\nCreate New non-root user

\nAdd a user

\nReferences

\nSet up User SSH Access

\nGenerate a New SSH Key

\nReferences

\nHarden SSH Service from Configuration File

\nOpen the Configuration File

\nChange the Default Port

\nDeactive Root Access

\nDeactivate Password Access

\nRestart SSH Service Configuration

\nReferences

\nDependencies

\nRemember # and $ symbols

\nLibrary Essentials

\nWhat are they for?

\nHow to install them?

\nDocs

\nDatabase Systems and Datastores

\nPostgreSQL

\nWhat is this for?

\nHow to install it?

\nVerify

\nDocs

\nMySQL

\nWhat is this for?

\nHow to install it?

\nDocs

\nRedis

\nWhat is this for?

\nHow to Install Redis

Ubuntu 14.04+

MacOS

From Source

\nVerify Installation

\nDocs

\nWeb Servers and App Servers

\nNginx Web Server

\nWhat is this for?

\nHow to install it?

\nVerify Installation

\nDocs

\nPhusion Passenger

\nWhat is this for?

\nHow to install it?

\nVerify Installation

\nDocs

\nLibraries

\nNodeJS

\nWhat is this for?

\nHow to install it?

\nVerify Installation

\nDocs

\nNVM - Node Version Manager

\nWhat is this for?

\nHow to install it?

\nVerify Install

\nDocs

\nRVM

\nWhat is this for?

\nHow to install it?

Bonus: install ruby

\nVerify Installation

\nDocs

\nWKHTMLTOPDF

\nWhat is this for?

\nHow to install it?

\nVerify Installation

\nDocs

\nImage Magick

\nWhat is this for?

\nHow to install it?