cubecraft-namedb

Creates database containing the names of all cubecraft.net forum users.

Installation

Requirements: sqlite3

git clone https://github.com/MagnificentSpam/cubecraft-namedb`
cd cubecraft-namedb
virtualenv -p python3 venv
. venv/bin/activate
pip install requests-html

Usage

python load.py [--delay <delay>] start_id end_id

For example to load all users (currently the latest user has the id 448140):

python load.py 1 448140

This will take a VERY long time.

Results

The results are stored as an sqlite3 database in two tables with the following columns:

users:

Column	Description
id	Profile id from the url
name	Current name
playername	Minecraft username or NULL if not linked
joined	Date joined, string as formatted on the website (may be "Today" etc.)
messages	Number of messages

oldnames:

Column	Description
user_id	Id of the corresponding user
name	Old name of the user

Example Queries

sqlite3 can be used to inspect the results.

List all usernames and old names:

select users.id, users.name, oldnames.name as oldname from users left join oldnames on users.id = oldnames.user_id;

Find the highest id in the database:

select id from users order by id desc limit 1;

Find all current names where

• the name is 6 characters long
• the last and second to last letter are the same
• the name does not contain the letters [a, i, m]
• the user has at least 150 messages

select name from users where length(name) = 6 and messages >= 150 and substr(name, 4, 1) = substr(name, 5, 1) and not name like "%a%" and not name like "%i%" and not name like "%m";