Photo by Luemen Rutkowski on Unsplash

Background

When developing software that has many potential uses, we may encounter a situation where potentially sensitive datasets are used by some users, but should not be available to others. …


How to convert to and from hex dumps using xxd

Photo by Juliana Malta on Unsplash

Motivation

In an earlier article, I explained the use of compiled binary files to hide the code run within them:

https://daniel-ellis.medium.com/compiling-a-shell-script-to-binary-8dac07b770df

However, it is not possible to set environmental variables using this method. MD5 checksums were considered, however, these are NOT…


Unlike the interactive Graphical User Interface, there is also a CLI for use on headless machines or HPC clusters, when local memory requirements just don’t cut it. Here we go over some of the basic functionality:

Photo by Henry & Co. on Unsplash

IPython

Although the script works through normal python or Jupyter notebooks, the most intuitive way…


A quickstart anaconda environment cheatsheet for everyday use.

Photo by Lucas Benjamin on Unsplash

Creating an Environment

We choose to create an environment named myenv

Within The Conda Folder

conda create --name myenv

Custom Location

A custom location (e.g. this directory under the name myenv)

conda create --prefix ./myenv python=3.7 --yes;

Cloning an Existing Env

conda create --name myenv --clone env2clone

Activating / Deactivating an Environment

Listing all environments

conda info --envs

To activate an environment

conda activate myenv

To activate a custom located environment

Activating an…


With the introduction of two-factor authentication, we are now required to change the way we access our repositories. There are now two main methods to upload to Github: using ssh keys or access tokens. This page describes the latter.

Photo by Markus Spiske on Unsplash

Creating a token

  1. Click on your user icon (top-right)
  2. Select Settings
  3. From the left-hand…

How to create a fully customised colour mapping within matplotlib.

Photo by David Pisnoy on Unsplash

Problem

Our data is split into non-uniform categories, where a linear colour bar will be inefficient. In this tutorial, we cover how to create a custom colourmap with colours matching bins of our chosen sizes.

Solution: Discrete Colour Bars

We start by importing the required…


Just some notes on getting started.

Photo by Carson Masterson on Unsplash

What is Bede?

Bede is the N8’s Tier 2 Power and GPU-based high-performance computing (HPC) platform.

Resources available

32x Main GPU nodes, each node (IBM AC922)

  • 512GB DDR4 RAM
  • 2x IBM POWER9 CPUs (and two NUMA nodes), with
  • 4x NVIDIA V100 GPUs (2 per CPU)
  • Each CPU is connected to its two GPUs via high-bandwidth, low-latency NVLink…

Notes on how to set up an interactive GPU session for computation on the Leeds System.

Photo by Pascal Brändle on Unsplash

Start a session

Arc4

qrsh -l h_rt=2:0:0,coproc_v100=1,h_vmem=8G -pty y bash

A single V100 card, 10 CPU cores and 48GB system memory (one quarter of the available resource on a V100 node)

Arc3

qrsh -l h_rt=2:0:0,coproc_k80=1 -pty y bash

A…


Sometimes we require multiple modules all of which communicate using the I2C channel. In this post, we discuss how to do exactly that using available GPIO pins.

Photo by Josh Spires on Unsplash

Setup

We begin with installing the required libraries,

sudo apt-get install -y python-smbus i2c-tools

followed by enabling I2C using the advanced tab within raspi…


You have a suite you wish to run, but need to constrain it such that it can run on your allocated queues — this guide explains how to break it into segments which allow you to do so.

Photo by Djim Loic on Unsplash

Accessing the run initialisation panel through rose

The run I am using is u-ca218 . First, you need to…

Daniel Ellis

Research Software Engineer specialising in Data Visualisation with a touch of HPC. — PhD in Atmospheric Chemistry and Masters in Theoretical Physics.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store