RPi Zero W – Day 3 – Test Bench Setup

Today I wanted to share how I am setting up my test bench for those that are curious. I have decided to use the DINr plates from the folks over at http://www.dinrplate.com/ since their design and implementation are second to none in my humble opinion.

As you can see from the photo below the board is securely fastened to the plate and then that plate is secured to the rail. All of the cables are zip tied to the plate which makes sure that the connections to your Single-Board Computer are not stressed out. The left micro-usb is power, the center micro-usb is for the WiFi dongle and the right is the micro-hdmi to hdmi converter.

dinrplate-dpz1
dinrplate-dpz1 holding the RaspBerry Pi Zero W

I highly recommend this setup if your going to be testing with your boards like I am since I have not found anything that is even close to the features and stability of this since I worked at Kodak. Amazon link to the setup I am using – DIN Rail Mount for Raspberry Pi Zero

Today’s test is with “stress-ng” – Bogo Ops

Stress-ng measures a stress test “throughput” using “bogus operations per second“. The size of a bogo op depends on the stressor being run, and are not comparable between different stressors. They give some rough notion of performance but should not be used as an accurate bench marking figure. They are useful to see if performance changes between kernel versions or different compiler versions used to build stress-ng. One can also use them to get a notional rough comparison of performance between different systems.

NOTE:
They are NOT intended to be a scientifically accurate bench marking metric.

To install this program copy and paste:

sudo apt install stress-ng

To learn more about the program you can read the options:

stress-ng –help | less

and you can read the manual

man stress-ng

Then to run it you would copy and paste:

stress-ng –cpu 0 –io 2 –vm 1 –vm-bytes 1G –timeout 30s –metrics-brief

Even more information if you want to really understand the program:

http://kernel.ubuntu.com/~cking/stress-ng/

Here are my results on both systems:

Tims-RPI-0-W-stress-ng-tests
Tims-RPI-0-W-stress-ng-tests

I will be working with stress-ng over the next few months to see just what I can do with it for future testing. If you know some good commands please share them below.

Here is the command I used on my brothers RaspBerry Pi 3

stress-ng –cpu 4 –io 2 –vm 1 –vm-bytes 256M –timeout 60s

stress-ng –cpu 4 –io 2 –vm 1 –vm-bytes 256M –timeout 60s –metrics

Tims-RPI-0-W-stress-ng-tests2
Tims-RPI-0-W-stress-ng-tests2
Tims-RPI-0-W-stress-ng-tests3
Tims-RPI-0-W-stress-ng-tests3

 

The idea behind these benchmarks is for you to see what the default setting provide you and then, if you want/need to, you can overclock your Single-Board Computer. Overclocking I will cover in later blogs.

So what’s next?

I have started with the command line testing with the RaspBerry Pi Zero W since that is where we can get the basic testing out of the way. The desktop environment on the RaspBerry Pi Zero is not very good for any kind of Internet testing. We will save that for the RaspBerry Pi 3. I will do all of the same tests on the RPi 3 so we can compare them against the RPi Zero W.

zero-project
zero-project

I has also planned on making this RaspBerry Pi Zero W into a USB dongle and I am also going to be adding the GPIO header to it.

raspi-gpio
raspi-gpio

Raspberry Pi Zero W – Day 2 – Benchmarks

How to Benchmark Your Single-Board Computer

I would like to establish a SOP (standard operating procedure) or  “methodology” going forward so all of you can create your own results. In order for this to be a fair test the following criteria were observed.

  • All CPU and memory tests conducted using Sysbench and/or command line.
  • All Single-Board computers were not contained in a case and used “bare”.
  • All tests using the latest version of that specific systems preferred software.
  • All tests were at ambient temperature before testing began.
  • I accessed the Single-Board computers over an SSH connection.
  • No desktop / X session started unless the tests required the desktop.
  • All test results are a combination of the tests being run 3 times and the mean average was used for the final result.

What is Sysbench

Sysbench is a benchmark suite which allows you to quickly get an impression about system performance which is important if you plan to run a database under intensive load. I will explain how to benchmark your CPU with Sysbench.

Installing Sysbench

From a terminal screen on Debian/Ubuntu/Mint/Raspbian, Sysbench can be installed as follows:

sudo apt-get install sysbench

If you want to learn more about the program you can look at the manual for Sysbench to learn more about its parameters.

man sysbench

CPU Benchmark

You can benchmark your CPU performance as follows:

If you have a single core processor, like a Raspberry Pi Zero, you can use this command:

sysbench –test=cpu –cpu-max-prime=20000 run

Tims-RPI-0-W-CPU-test-1
Tims-RPI-0-W-CPU-test-1

If you have a multicore cpu you can use this command:

sysbench –test=cpu –cpu-max-prime=20000 run –num-threads=4

Tims-Pc-CPU-test-1
Tims-Pc-CPU-test-1

RAM Benchmark

sysbench –test=memory –memory-block-size=1M –memory-total-size=10G run

Tims-RPI-0-W-mem-test-1
Tims-RPI-0-W-mem-test-1
Tims-Pc-mem-test-1
Tims-Pc-mem-test-1

Terminal command line benchmark testing

Integer calculation performance test with  one-line command

time $(i=0; while (( i < 1234567 )); do (( i ++ )); done)

This will return the the time required to crunch the integers between 0 to 1234567.

Tims-RPI-0-W-CPU-test-2
Tims-RPI-0-W-CPU-test-2
Tims-Pc-CPU-test-2
Tims-Pc-CPU-test-2

RAM speed testing

There is no direct method to benchmark a RAM and generally RAM speed  denotes RAM clock speed. It is unnecessary and not conclusive to do this test but this may be considered as an experiment. As you can benchmark this data with changes you do to your system or compared to other systems. 

tmpfs is a RAM based super fast file system, something like a ramdisk, so by doing a read write speed test on a tmpfs mounted folder will give a rough idea about RAM speed. So, let’s have a look at commands below.

mkdir RAM_test
# mount the tmpfs filesystem
sudo mount tmpfs -t tmpfs RAM_test/
cd RAM_test

# write to RAM test
dd if=/dev/zero of=data_tmp bs=1M count=512
# read to RAM test
dd if=data_tmp of=/dev/null bs=1M count=512

Here are the results for the Raspberry Pi Zero W. I achieved around 35 MB/s write speed and 79 MB/s read speed with a 512MB of DDR2 SDRAM.

Tims-RPI-0-W-RAM-test-1
Tims-RPI-0-W-RAM-test-1

On my main PC look at the result ! It’s incredibly fast ! I achieved around 4.6 GB/s write speed and 8.0 GB/s read speed with a 16GB 2400MHz DDR4 RAM.

Tims-RPI-0-W-RAM-test-2
Tims-RPI-0-W-RAM-test-2

Time to clean up what you just did.

cd ..
# umount the tmpfs filesystem
sudo umount tmpfs -t tmpfs RAM_test/
# delete the directory you created
rm -r RAM_test

NOTE: My main computer is an I5 with 16GB DDR 4 ram at 2400MHz
It is a dual boot with Win 10 and Linux Mint

More testing coming up!