Browsed by
Category: Linux

[Ubuntu] Install Hadoop 3.0.0 & Hive on Ubuntu 16.04

[Ubuntu] Install Hadoop 3.0.0 & Hive on Ubuntu 16.04

What’s Hadoop?

hadoop-logo
Hadoop is an open-source framework that allows to store and process big data in a distributed environment across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage.

The project includes these modules:

Hadoop Common: The common utilities that support the other Hadoop modules.
Hadoop Distributed File System (HDFS™): A distributed file system that provides high-throughput access to application data.
Hadoop YARN: A framework for job scheduling and cluster resource management.
Hadoop MapReduce: A YARN-based system for parallel processing of large data sets.

What’s Hive?

hive_logo
The Hive data warehouse software facilitates reading, writing, and managing large datasets residing in distributed storage using SQL. Structure can be projected onto data already in storage. A command line tool and JDBC driver are provided to connect users to Hive.

Read More Read More

[Ubuntu] Install Spark2.2.1 on Ubuntu 16.04

[Ubuntu] Install Spark2.2.1 on Ubuntu 16.04

What is Spark?

Apache Spark is a fast and general-purpose cluster computing system. It provides high-level APIs in Java, Scala, Python and R, and an optimized engine that supports general execution graphs. It also supports a rich set of higher-level tools including Spark SQL for SQL and structured data processing, MLlib for machine learning, GraphX for graph processing, and Spark Streaming.

You can download Spark from here, or follow the below instructions to download and install Spark2.2.1.

Read More Read More

[WP] How to Add SSL and HTTPS in WordPress?

[WP] How to Add SSL and HTTPS in WordPress?

SSL plays an important role in website, because in the last year Google announced that they will be using HTTPS and SSL as a ranking signal in their search results. This means that using HTTPS and SSL will help improve your site’s SEO.

Using an SSL certificate for your WordPress site means that your data, as well as your users’ data, remains safe from prying eyes. Since WordPress is a particularly large target for hackers due to its popularity and transparency, it’s important to take all the appropriate steps toward securing your site.

If you host a wordpress website by yourself, you may need to install SSL certificate on your website. I found a simple way to install SSL certificate through commands and the most important thing is this SSL certificate is free. Oh yes, you need to have the basic knowledge of SSH, Linux and Bash.

Read More Read More

[Ubuntu] Install chef-server, chef management console on Ubuntu 14.04

[Ubuntu] Install chef-server, chef management console on Ubuntu 14.04

What is Chef?

Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one (or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client (which is installed on every node) does the actual configuration.

Read More Read More

[Linux] Install PostgreSQL 9.4 on CentOS 7

[Linux] Install PostgreSQL 9.4 on CentOS 7

postgresql-logo

About
PostgreSQL is a powerful, open source object-relational database system. It has more than 15 years of active development and a proven architecture that has earned it a strong reputation for reliability, data integrity, and correctness. It runs on all major operating systems, including Linux, UNIX (AIX, BSD, HP-UX, SGI IRIX, Mac OS X, Solaris, Tru64), and Windows.

Read More Read More

[Java] Install/uninstall Oracle/Open JDK, Maven, Ant, Tomcat on Ubuntu14.04

[Java] Install/uninstall Oracle/Open JDK, Maven, Ant, Tomcat on Ubuntu14.04

I used the following command to install Java tools on Ubuntu14.04 , and it also works for old Ubuntu version.

Install Oracle JDK6, JDK7, JDK8

$ sudo apt-get install python-software-properties
$ sudo add-apt-repository ppa:webupd8team/java
$ sudo apt-get update
$ sudo apt-get install oracle-java6-installer

or

$ sudo apt-get install oracle-java7-installer

or 

$ sudo apt-get install oracle-java8-installer

Read More Read More

[Linux] The command lines for network setting

[Linux] The command lines for network setting

1. IP and Subnet Mask setting

  • Assign IPv4 addresses to Network Interface
    $ ifconfig *interface* *IPv4 address*
    
    e.g:
    $ ifconfig eth0 192.168.10.91
    
  • Assign IPv6 address to Network Interface
    $ ifconfig *interface* inet6 add *IPv6 6Address*/*IPv6 Prefix Length*
    
    e.g: 
    $ ifconfig eth0 inet6 add 2001:b030:7015:ff01::1/64
    
  • Assign a IPv4 Subnet Mask to Network Interface
    $ ifconfig *interface* netmask *IPv4 Subnet Mask"
    
    e.g: 
    $ ifconfig eth0 netmask 255.255.255.0
    
  • 2. default gateway setting:
  • Assign IPv4 Gateway to Network Interface
    $ route add default gw *IPv4 Gateway* *interface*
    
    e.g:
    $ route add default gw 192.168.10.254 eth0
    
  • Assign IPv6 gateway
    $ route -A inet6 add default gw *IPv6 gateway*
    
    e.g: 
    $ route -A inet6 add default gw 2001:b030:7015:ff01::ffff
    
  • DNS setting:
    $ vim /etc/resolv.conf
    
    nameserver *ip adress*
    
    e.g:
    nameserver 8.8.8.8
    
[Ubuntu] Using Amazon RDS with WordPress

[Ubuntu] Using Amazon RDS with WordPress

In order to improve efficiency and elasticity of EC2 instance, we need to use a database that is installed on a separate machine. A good solution is using AWS RDS. Before we create a database RDS instance, we need to make a dump of the existing database on our WordPress server.

In the following, I will list these instructions.

Read More Read More