Raspberry Pi 4
Wow, Raspberry Pi 4 is now available with 8GB of DDR4 memory! This is still a crazy good value for something that costs less than $100 ($75 for just the Raspberry Pi itself, actually) and runs modern operating systems with most of functionality you come to expect from a Linux desktop!
I needed to forward X11 output from one of my Linux servers recently to run virt-manager (manager for virtual machines in KVM), and because it’s been a while I had to download and install X11 server again.
I love reading man pages for even the most basic Unix commands like ls, because there’s always something interesting to learn. Today I discovered that it’s possible to sort ls output by file size.
As I mentioned, I’m building a new Linux based desktop PC – currently running RHEL 8. Since I’m planning it as a primary desktop system for my home lab, I want to eventually migrate workflows from MacBook Pro to the new PC – and this means I want to use my existging LG 5K UltraFine 27” display. This seemed like an interesting Unix Tutorial Project from the very start!
Apparently, Debian installer doesn’t install or activate sudo by default. This means that sudo command is not found the only privilege escalation method available is becoming root via su command. Since I like and use sudo daily, I decided to install and setup it on Debian VM.
I’m slowly improving my Python skills, mostly by Googling and combining multiple answers to code a solution to my systems administration tasks. Today I decided to write a simpe converter that takes Epoch Time as a parameter and returns you the time and date it corresponds to.
I had a server run out of space recently, to the point that it couldn’t complete the yum update. This server ended up corrupting a yum packages database.
Now and then you may notice that apt-get upgrade command keeps a few packages back, meaning they don’t get upgraded. This quick post shows what you can do about it and how to get all the packages upgraded.
Unlike chmod command, chown only becomes useful if run with elevated (root) privileges. In Linux, it is most commonly used with the help of sudo command.
I know that the upcoming Linux Mint release will be based on the just-released Ubuntu 19.04, but just couldn’t wait this long to try Ubuntu 19.04 and all the improvements it brings. So my past few week’s project has been to install Ubuntu 19.04 on my Dell XPS 13 9380 laptop.
This week’s Unix Tutorial Project is super geeky and fun: I’m setting up text-based email archive system using Mutt (NeoMutt, actually), OfflineIMAP and hopefully NotMuch. Will publish a project summary on the weekend.
Call me old fashioned, but I still prefer using ifconfig command. It’s not as cool as the ip command found in recent Linux distros, but familiar and universal enough to be found pretty much everywhere else. This post shows how to install packages to make ifconfig working again.
I really like the Hack font – it’s used in my terminal apps on MacOS, Linux and even Windows workstations. This short post demonstrates how to install Hack font, but you can use the steps to configure any other TrueType Font (TTF) on your system.
One of the most useful and powerful basic Unix commands, chown command allows you to change ownership of specified files and directories – change user or group owner.
As you can imagine, SSH keypairs – combinations of private and public keys – are vital elements of your digital identity as a sysadmin or a developer. And since they can be used for accessing source code repositories and for deploying changes to production environments, you usually have more than one SSH key. That’s why it’s important to know how to inspect SSH key fingerprints.
Since awk field separator seems to be a rather popular search term on this blog, I’d like to expand on the topic of using awk delimiters (field separators).
I have a tiny server in home office, it used to be a Window 8 based entertainment box but I reinstalled it with Ubuntu 18.10 recently enough to run home automation. There has’t been any particular function assigned to this server but I have finally decided what role it will play: it will be an always-on Ubiquiti UniFi controller for my home office network!
diff is a mightly command line tool found in most of Unix and Unix-like operating systems. diff helps you to find differences between files and directories.
Now and then, especially when working on a development environment, you need to stop multiple Docker containers. Quite often, you need to stop all of the currently running containers. I’m going to show you one of the possible ways.
If for whatever reason you stop using a certain service in your Ubuntu install and would like to disable automatic restarting for it upon system reboot, all it takes to do it is just one command line.
Screen Shot 2019-01-05 at 17.29.36.png
dd command, that is pretty much guaranteed to be pre-installed on your Linux or Unix server, can be used to quickly get an understanding of the I/O capability of available storage.
You probably know about curl command: it’s great for downloading web pages or files from a Unix command line. But there’s another great usage curl command has: testing TCP ports connectivity.
One of the very first questions a Linux user asks is about confirming the release (OS version) in use. Knowing release helps with highlighting software dependencies and compatibilities, confirms availability of certain features in your OS and simplifies the process of system administration – certain releases have a preferred set of commands for day-to-day management.
New Linux users often get puzzled by the “mkdir: cannot create directory” errors when taking first steps and trying to learn basics of working with files and directories. In this short post I’ll show the two most common types of this mkdir error and also explain how to fix things so that you no longer get these errors.
IMPORTANT: This is a post from another blog of mine, which I’m shutting down. I like the way these virtualization concepts were worded in such a relatively simple way, so I’m keeping the post 🙂
Many of us have heard about hardware virtualization, but as far as I can see there is still a lot of confusion around this term and surrounding technologies, so today I’ve decided to give a really quick intro. Some time in the future, I’ll probably cover this topic in detail.
I explained how to read the /proc/mdstat in my recent post How To Identify RAID Arrays in Linux, so today is a super quick follow up using one of my systems.
Because I own a number of Raspberry Pi systems, I get roughly the same question quite regularly about each one of them: how can I confirm what this Raspberry Pi model is from the command line? The reason I usually want to know is because the model of the Raspberry Pi hints the Raspbian release that will support it (older Raspbian releases do not have support for the most recent models of Raspberry Pi).
When you want to save yourself from typing an unwieldy command over and over again you can create and use an alias for it. It will then act as a shortcut to the larger command, which you can type and run instead.
The tmux tool, or the terminal multiplexer, is great for allowing you to run multiple terminals side by side. What’s even better is that you can somewhat customize its behavior using the tmux.conf file. The meta key is the prefix you press before you issue a command that controls tmux so you can, for instance, split the terminal in two. By default it is set to CTRL-B, and this is how you can change that.
Some properties of ext2, ext3, and ext4 file systems on Linux and UNIX can be tuned on the fly using the tune2fs command. This includes the file system’s label.
The unrar program, which serves to open and extract popular .rar archives, is often available for install from repositories of a given Linux distribution. That should make installing it easy by using your distribution’s package management system. That can be either a graphical user interface program like Ubuntu Software Center, or a command like tool like apt-get.
Finding out sizes of files and directories in Linux is done using the du command, which estimates their disk space usage. The du command can be used with options that allow you to customize the results you get.
The visudo command is a safe and secure way of editing the /etc/sudoers file on UNIX and Linux systems. /etc/sudoers is instumental for gaining privileged access via sudo command.
The visudo command is a safe and secure way of editing the /etc/sudoers file on UNIX and Linux systems. /etc/sudoers is instumental for gaining privileged access via sudo command.
The mkfs command available in UNIX and Linux operating systems is used to create file systems on various storage devices or partitions. It stands for “make filesystem”, and creating a file system is essentially an equivalent to what is popularly known as “formatting” a disk or a partition with a particular file system type (such as FAT32 or NTFS in Windows).
I had to download a piece of software today for one of the servers which I haven’t used in a while. A question of confirming the 64bit CPU capability came up, and I realized that I never mentioned it here on Unix Tutorial.
I’ve just been asked a question about changing the ownership of files from one Unix user to another, and thought it probably makes sense to have a quick post on it.
Yesterday in my post on numeric userids instead of usernames, I touched briefly the problem of recovering the username if you only know the userid it once had. Today I would like to show you another option which may be available to you when it comes to recovering the usernames of removed users by their userid.
As you know, every file in your Unix OS belongs to some user and some group. It is very easy to confirm the ownership of any file because user id and group id which own the file are always linked to the file. However, sometimes you can’t tell which user owns the file, and today I’m going to explain why. It’s a rather lengthy post and a complicated matter, so please leave questions or comments to help me polish this article off.
Today I’d like to show you the basic usage of rsync – a wonderful, old and reliable tool for incremental data transfers and synchronization of local directories or even data between different Unix systems.
If you’re interested in what exactly your Ubuntu system has got installed, there’s a command you can use to list the packages along with their versions and short descriptions.
If you’re logged in at some remote Linux system and need to quickly confirm the amount of available memory, there’s a few commands you will find quite useful.
Certain situations require you to quickly confirm which files between two directories are different, and while your particular requirements may suggest writing a script for this task, I want to make sure you’re familiar with the basics first – majority of directory comparisons can be done using diff command (yes, that’s right – the same one used for comparing files).
Showing your processes in a hierarchical list is very useful for confirming the relationship between every process running on your system. Today I’d like to show you how you can get tree-like processes lists using various commands.
As you know, Unix filesystems store a number of timestamps for each file. This means that you can use these timestamps to find out when any file or directory was last accessed (read from or written to), changed (file access permissions were changed) or modified (written to).
Another quick answer to the question I see a lot in search queries on this blog: listing directories in a directory. I take it that this question means showing a list of only the directories and not other files under a certain location of your Unix filesystem.
Very quick tip for you today, I just see that many of visitors of this block are curious how they can find a directory in Unix – and so here’s a command to help you do just that.
When you’re trying to clean up your filesystems and reclaim some space, one of the first things you’ll want to do is to confirm the largest directories and individual files you have. This can be easily done using two Unix commands: find command and du command.
To some this may seem like a trivial task, but I see great interest from Unix/Linux beginners arriving to this blog: how exactly does one confirm what a symlink points to?
AWS command line interface (CLI) enables you to control your AWS environment from your local client terminal. You can use CLI to configure, monitor, and automate resource management. This article provides a walkthrough that explains how to use AWS CLI. You will also learn five very useful AWS CLI commands.
How to Use the AWS CLI
The AWS command line interface (CLI) is a tool provided by Amazon to help you manage your resources and services. It enables you to control your environment from the terminal of your local client. You can use it to change configurations, monitor assets, and automate the management of resources through scripting.
How to download and install the AWS CLI on Windows
Edit the ~/.aws/config file and add your Access Key ID, Secret Access Key, and region.
Protect the config file by running chmod 600 ~/.aws/config
Basic command structure
Most AWS commands have the following structure:
aws <command> <subcommand> [options]
You can see the full documentation for details of all commands.
AWS Command Line Interface Tricks and Shortcuts
When getting started with the AWS CLI, there are a variety of tricks and shortcuts you can use to increase your productivity. Below are a few that are particularly useful.
Drilling down for help
Your cloud environment is made of a collection of services. Each service has a different set of options and commands that can be difficult to remember. Rather than having to search through the documentation to find these options and commands, you can use the help command built into the AWS CLI.
To access this command, you need to type aws help. This pulls up a list of globally available commands. You can refine this command by inserting the service name for more specific options. For example, if you’re trying to manage your EBS volumes but have forgotten which commands you need, you can aws ebs help –.
Once you find the command you need, you can even drill down further by inserting the command name after the service name. For example, aws ebs describe-service help. This enables you to quickly access only the information you need. Alternatively, you can use aws help topics to view a full list of your available options.
Setting up auto-complete for commands
Built-in to the AWS CLI is an auto-complete feature for commands. This feature helps speed your CLI use by predicting which commands you are typing and enabling you to quickly insert text with the Tab key.
This feature is preconfigured for Amazon Linux but may require some configuration if you are using another OS. For example, on non-Linux platforms, developers must define the location of the AWS_Completer script and the name of the shell in use.
To accomplish this, you can use the echo $SHELL command. This will tell you which shell you’re using if you aren’t sure. Then, you can use the Which AWS_Completer command to find the location of your script.
Create command templates with skeletons
One practice when working with collections of complex commands is to create text files containing those commands. These can be shared amongst teams and referenced as needed. However, these files can be a pain to modify or update.
As an alternative, the AWS CLI includes utilities that you can use to generate a skeleton. Skeletons enable you to modify input parameters for complex commands using JSON files as opposed to scripts. To create a skeleton, you can use the command –generate-cli-skeleton.
Another option is to implement chains of commands from the CLI. This tool enables you to combine commands to be run sequentially or to drive future commands with the output of the current one.
5 Super Useful AWS CLI Commands
Now that you understand a few of the tricks and shortcuts available to you, it may be helpful to see some commands in action. Below are some of the most commonly used commands and ones you may want to remember.
Delete an S3 bucket and all its contents
S3 buckets can grow to massive sizes, with thousands of files contained within. While you can individually delete files, this is time-consuming and unnecessary if you know the bucket is unneeded.
Rather than going through one by one, you can duplicate any files you may need and then delete the bucket as a whole. The command to accomplish this is:
aws s3 rb s3://your-bucket –force
Display subsets of all available ec2 images
When managing EC2 instances, you may be unsure which images you are using. Rather than individually checking, you can call up a description of all available images. You can use this command on its own, or you can filter the images by type. For example, the following command defines available images built on Ubuntu as called from a Mac or Linux machine:
aws ec2 describe-images | grep ubuntu
List users in a different format
When viewing lists of users, especially long lists, the format can make interpretation and use a challenge. When displaying these lists, the format depends on the default you have set.
However, you may need that format for other processes while manual list calls are infrequent.
Rather than manually reformatting lists or temporarily modifying defaults, you can output lists in a table format. The following command can help you achieve this:
aws iam list-users –output table
Move S3 bucket to a different location
Sometimes, rather than deleting buckets what you really need is just to move the files to the appropriate location. You can do this by copying and then deleting the unnecessary duplicate but this is slow and prone to error. A better alternative is to move the bucket with the following command. This example moves a bucket from the US West 1 region to the US West 2 region.
List all of your instances that are currently stopped and the reason for the stop
Downtime in your cloud environment can be a nightmare, ruining productivity and causing revenue loss. When downtime occurs, you need to quickly identify which instances are affected and what caused the outage. You can accomplish this with a command like the following one.
Hopefully, this article has helped you better understand how to use AWS CLI. By now, you should be able to download and install AWS CLI on Windows, Mac, or Linux. Remember that whenever you need a reference, you can frill down for help, rather than go look for the documentation. You can also set up auto-complete for commands, and create command templates with skeletons. These three tricks, if implemented continually, can save you a lot of time and effort as you scale up your operations.
Follow me on Facebook and Twitter or jump into Telegram chat!:
Recommended Software
I use Brave browser, it's awesome:
I'm also a fan of SetApp for macOS:
IT Consultancy
I'm a principal consultant with Tech Stack Solutions. I help with cloud architectrure, AWS deployments and automated management of Unix/Linux infrastructure. Get in touch!