Not much action on gtk-devel-list

The mailing list for GTK+ is gtk-devel-list@gnome.org. Unfortunately, it seem to be serverly underused and it is almost impossible to get discussions going there. Most discussions seem to take place at bugzilla or the (in)famous planet.gnome.org. But part of the problem also seem to be that most gtk developers are employed by a few companies, namely Red Hat and Imendio. When you work in the same office it becomes easier to communicate orally, than having to use a text medium.

I think it would be nice if there was more "flow" on the mailing list. I fear that important information is getting lost and it creates a divide between employed hackers and others.

Jumpstarting Waf

Introduction

This document is an introduction to the build-tool waf. Waf is a tool written in Python for setting up automated build systems for a programming projects.

Intended Audience and Prerequisite Knowledge

It is assumed that the reader is interested in using waf for setting up the build for a project. The instructions given were recorded on a Linux system and might not be suitable for Windows users.

Why is a Build System Needed?

The build and distribution problem is one of the hardest problems in applied computer science. You have to make sure that your software works in a totally unknown environment radically different from the one in which it was developed.

Additionally if the build fails, the user of the software must be informed in a graceful way with a description of why.

Why Waf?

As previously described, building software is hard. There are many build systems out there, but only waf and autotools provides a holistic system that takes care of every step from configure to distribution. waf has several advantages over autotools that makes it preferable:

  • waf uses Python while autotools mixes shell scripting, M4 and Perl.
  • waf does not generate intermediate files that confuses users like autotools does.
  • waf is many times faster than autotools.

Installing Waf

The first step in using Waf is to install it. I recommend checking it out from Subversion instead of downloading a tarball as the former usually is much more up to date and contains the latest bugfixes. As of this writing, the repository is at revision 4813. Create a checkout using:

$ svn checkout http://waf.googlecode.com/svn/trunk/ waf-read-only

To build waf, enter the waf-read-only directory generate the waf script:

$ cd waf-read-only
$ ./waf-light --make-waf

This creates an exectuable Python script called waf. This script should be copied to the root directory of any project you want to use waf for. It is also possible to install waf globally, although that is not recommended. The README file has more details.

The First wscript

Each build tool has its own kind of configuration files. make has Makefiles, autoconf has configure.in-files, scons has SConstruct files and so on. waf has wscripts. So the first step is to create an initial bare-bone wscript file. Copy this to a file named wscript in your project root directory:

srcdir = '.' blddir = 'build' def set_options(opt): pass def configure(conf): pass def build(bld): pass

Note that this a regular Python program and that you can enter whatever Python code you want in it.

Explanation

srcdir = '.'

The srcdir variable informs waf of where the source files are in relation to the wscript. Its value will almost always be '.' which is the current directory.

blddir = 'build'

This variable tells waf where to put the built files. By default, waf uses an out-of-tree build process, in contrast to most autotooled projects which are built in-tree, which means that waf will not litter your source directories.

def set_options(opt): pass

The set_options function is used for modifying the global options object passed in as the opt parameter. Here you can add extra options both for configuring and building.

def configure(conf): pass

This function performs the exact same task as the configure script in autotooled projects -- it checks that all the requirements for the software is fullfilled.

def build(bld): pass

build defines how the software is to be built. Target rules are specified here.

Running the Build

Provided that the waf program is in the same directory, it is now possible to run this empty build process:

$ ./waf configure
Configuration finished successfully (00:00:00); project is now ready to build.
$ ./waf build
Compilation finished successfully (00:00:00)

We haven't told waf what to do yet, so it outputs nothing interesting. waf creatures a directory called build/ which contains the result of the build process:

$ find build/
build/
build/config.log
build/c4che
build/c4che/build.config.py
build/c4che/default.cache.py
build/default
build/.wafpickle-6

Each built file is placed in build/default, the other files are just house-keeping for waf. Truth be told, this isn't all that interesting, but it gets better in the next section where we make waf actually do something useful.

wafing a Project

Lets talk about the imagined project we are using waf for for a while. We are creating a very simple shared library written in C complete with documentation, tests and example programs.

File Structure

Our project contains the following files and directories:

$ find
.
./wscript
./waf
./src
./src/hello.c
./src/hello.h
./src/wscript_build
./tests/test.c
./tests/demo.c
./tests/wscript_build
build/
As mentioned before, this is where waf puts the built files.
docs/
Project documentation.
src/
C sources and header files for the shared library.
tests/
Tests and example programs.

The hello.c and hello.h files are the C sources. First hello.c:

#include <stdio.h> #include "hello.h" void say_hi () { printf ("Ho\n"); }

And hello.h:

#ifndef HELLO_H #define HELLO_H void say_hi(); #endif

The other files will be introduced as needed in later sections.

Source Targets

Since this a C project, we must add configure checks to waf to ensure that the user has a C compiler installed before the project can be built. Lets begin with that:

def set_options(opt): opt.tool_options('compiler_cc') def configure(conf): conf.check_tool('compiler_cc')

These lines adds C compiler options and configure checks. Rerunning ./waf configure outputs the following:

$ ./waf configure
Checking for program gcc                 : ok /usr/bin/gcc
Checking for compiler version            : ok 4.2.4
Checking for program cpp                 : ok /usr/bin/cpp
Checking for program ar                  : ok /usr/bin/ar
Checking for program ranlib              : ok /usr/bin/ranlib
Checking for gcc                         : ok
Configuration finished successfully (00:00:00); project is now ready to build.

This proves that waf is now verifying that the user has a C compiler installed. Next we add target definitions for the source files in the src directory. Create a file called wscript_build to the src directory.

obj = bld.new_task_gen('cc', 'shlib') obj.source = ['hello.c'] obj.target = 'hello'

These three lines work similar to a build rule in a makefile. The file hello.c is used as input to build the shared library libhello.so. Note that waf automatically adds the prefix "lib" and the suffix ".so" because we are using Linux. To add this target to the build process change the build function in the wscript file:

def build(bld): bld.add_subdirs('src')

This instructs waf to add the rules from any wscript or wscript_build file located in src. The code serves the same purpose as the SUBDIRS variable in Makefile.am variables. Naturally, it is also possible to put all build information in the main wscript file but that might get messy because all paths gets longer. On the other hand, fewer files might feel less cluttered.

Let's test the build:

$ ./waf build
[1/2] cc: src/hello.c -> build/default/src/hello_1.o
[2/2] cc_link: build/default/src/hello_1.o -> build/default/src/libhello.so
Compilation finished successfully (00:00:00)

Excellent! waf first executed the compilation creating hello_1.o and then linked it to produce libhello.so. Both stored in build/default/src/:

$ ls build/default/src/
hello_1.o  libhello.so

Preprocessor Defines

A preprocessor define instructs the compiler to replace all subsequent occurences of a macro with specified replacement tokens. The canonical way to pass compile time options is to let the build system create a "config.h" header file that all C source files includes.

Using config.h

Let's say we wan't to add a function to our hello library that returns its version. First we add the necessary code to the wscript file to create the config.h file with the necessary define:

VERSION = '1.0.0' srcdir = '.' blddir = 'build' def set_options(opt): opt.tool_options('compiler_cc') def configure(conf): conf.check_tool('compiler_cc') conf.define('PACKAGE_VERSION', VERSION) conf.write_config_header('config.h') def build(bld): bld.add_subdirs('src')

The two new lines in the configure function creates the macro PACKAGE_VERSION and writes it to the config.h file. Configuring the project creates the config.h file in the build/default/ directory:

/* Configuration header created by Waf - do not edit */ #ifndef _CONFIG_H_WAF #define _CONFIG_H_WAF #define PACKAGE_VERSION "1.0.0" #endif /* _CONFIG_H_WAF */

By including config.h in hello.c, the macro can be used in the new function:

#include <stdio.h> #include "hello.h" #include "config.h" void say_hi () { printf ("Ho\n"); } const char * get_version () { return PACKAGE_VERSION; }

The function is also added to the header:

#ifndef HELLO_H #define HELLO_H void say_hi(); const char *get_version () #endif

The defines attribute

It is also possible to pass the defines as compiler arguments using gcc's -D option (or the equivalent for other compilers). Each target object in waf has a "defines" attribute where the defines are listed.

So to accomplish what we did in the previous chapter, without using a config.h file, change src/wscript_build to the following:

obj = bld.new_task_gen('cc', 'shlib') obj.source = ['hello.c'] obj.target = 'hello' obj.defines = 'PACKAGE_VERSION=\\"%s\\"' % VERSION

Note that an extra level of string escaping is needed to get the string literal correctly passed to the compiler from the shell.

Which ever way you prefer to use is a matter of taste. But when the list of defines grow large, the config.h method certainly becomes more pleasant. Even if it sometimes can increase recompile times.

Building GTK-Doc Documentation

Integrating the documentation building step into the build tool is usually tricky. End users usually does not need to rebuild the documentation and most documentation tools such as Javadoc and Doxygen does not integrate very easily into a target-based system.

Never the less, the popular documentation extraction tool GTK-Doc for GTK+ libraries contains a bunch of autotools macros so that it can be built using make. waf can do that too, ofcourse.

First, we have to write some documentation for our two functions in hello.c. GTK-Doc uses a pretty self-explanatory doc comment syntax reminiscent of Javadoc. We also add a third function, just for fun. The resulting hello.c and hello.c files are:

#include <stdio.h> #include "hello.h" /** * say_hi: * * Prints "Ho\n" on standard out. **/ void say_hi () { printf ("Ho\n"); } /** * get_version () * @returns: a string containing the version of this library. * * Returns a string on the format "major.minor.micro" describing which * is this librarys version. **/ const char * get_version () { return PACKAGE_VERSION; } /** * get_day_name: * @day_index: index of a week-day, in the range 0-6. * @sunday_first: one if a calendar with the week starting on Sunday * is desired, zero otherwise. * @returns: the name of the day, or %NULL if @day_index is out of * range. * * Returns the name of the day corresponding to the specified day * index. **/ const char * get_day_name (int day_index, int sunday_first) { const char *days[] = {"Monday", "Tuesday", "Wednesday", "Thursday", "Friday", "Saturday", "Sunday"}; if (day_index < 0 || day_index > 6) return NULL; if (sunday_first) day_index = (day_index + 6) % 7; return days[day_index]; }

and hello.h:

void say_hi (); const char *get_version (); const char *get_day_name (int day_index, int sunday_first); #endif

Adding Documentation Option

Autotooled projects employing GTK-Doc all have a --enable-gtk-doc configure option that determines whether the build process will build the documentation or not. It is easily added to waf by modifying the set_options function in the wscript file:

def set_options(opt): opt.tool_options('compiler_cc') opt.add_option('--enable-gtk-doc', action = 'store_true', default = False, help = 'use gtk-doc to build documentation ' + '[default: %default]')

Waf uses the standard library optparse module for parsing the command line, so any option format accepted by optparse will work for waf. See the documentation for that module for more information.

We can check that the extra option has become available:

$ ./waf configure --help
usage: waf [options] [commands ...]

* Main commands: configure build install clean dist distclean uninstall distcheck
* Example: ./waf build -j4

options:
  --version             show program's version number and exit
  -h, --help            show this help message and exit
  -j JOBS, --jobs=JOBS  amount of parallel jobs [Default: 2]
  -f, --force           force file installation
  -k, --keep            keep running happily on independent task groups
  -p, --progress        -p: progress bar; -pp: ide output
  -v, --verbose         verbosity level -v -vv or -vvv [Default: 0]
  --destdir=DESTDIR     installation root [Default: '']
  --nocache             compile everything, even if WAFCACHE is set
  -b BLDDIR, --blddir=BLDDIR
                        build dir for the project (configuration)
  -s SRCDIR, --srcdir=SRCDIR
                        src dir for the project (configuration)
  --prefix=PREFIX       installation prefix (configuration only) [Default: '/usr/local/']
  --zones=ZONES         debugging zones (task_gen, deps, tasks, etc)
  --targets=COMPILE_TARGETS
                        compile the targets given only [targets in CSV format, e.g. "target1,target2"]
  -d DEBUG_LEVEL, --debug-level=DEBUG_LEVEL
                        Specify the debug level, does nothing if CFLAGS is set in the environment. [Allowed
                        Values: 'ultradebug', 'debug', 'release', 'optimized', 'custom']
  --enable-gtk-doc      use gtk-doc to build documentation [default: False]
  ^<- here it is!

  C Compiler Options:
    --check-c-compiler=CHECK_C_COMPILER
                        On this platform (linux) the following C-Compiler will be checked by default: "gcc
                        suncc"

Go Obama!

Pretty, pretty please make the Americans vote right this time.

Min näsa

Jag slog i näsan hårt under surfsemestern i Lacanau. Den är nu permanent något böjd. Ingen större fara hoppas jag inte, dock lite sorgligt ändå. Tack till den trevliga vårdpersonal som hjälpte mig idag samt till den rolige läkare som bokstavligt talat knäckte den rät.

Innan:

Efter olyckan:

Efter fixen:

Död

Tar bort det här mtp mordmisstankarna. Naturligtvis skriver tidningarna det, men det gör det ju ännu värre! Usch.

Björn Lindqvists Extraordinära Konsultfirma

är registrerad! Annat noterbart är att skuldsaneringsuppgifter tydligen är offentlig information. Tråkigt för Anita, Curt, Kenneth m.fl. Personnummer är tydligen inte speciellt hemliga heller.

Det var allt från VD:n.

Personal Issues

Dammit. I can't help it but I still take it personal when someone rejects my bugs or patches. I hate it! The worst thing is that I know I am right. Either I am a bad communicator or people are just thick. I know what option I would like to believe in. Grrrr...

Kukskallar

143 riksdagsledamöter är kukskallar. Vad ska vi göra med dem? Kanske borde de tänka efter vad de spenderar sina liv på. Leva i lyx med fet riksdagslön... Viktigare än att tänka efter och framföra sin ärliga åsikt. Zombies.

FRA suger

FRA lagen är helt sjuk. Vi måste få fegisar som Frederick Federly på bättre tanker. Borgaras. Hoppas på många utanför riksdagshuset 08:00 18/6.

Banana Knowledge

Sometimes Slashdot actually contain some interesting stuff, like this article about bananas. Like this comment:

So, was granpa's banana more slippery?
Actually, that's a slightly hedged 'yes'.
Grampa's banana had a thicker, more durable skin, in addition to being larger than the bananas we youngun's know so well. The other reason it's so popular as comic relief is because it actually was a real hazard back around 1915-ish. As a 'portable' fruit, they were handy to carry anywhere, and without streetcorner trash cans, the peels got tossed on the sidewalk as often as not. And considering bananas are (and were) the most popular fruit in the US (almost twice as popular as the good ol' apple), it really was a normal hazard. The Boy Scout handbook of 1914 actually listed removing a banana peel from the sidewalk as a 'good deed', it was that common an occurence.

Did you know that the current type of banana everyone eats is called Cavendish because the previously most popular banana Gros Michel went extinct in the 60's?

Nya dojor

Det här är mina nya löparskor. De kostade 1600 kr men jag tror det var värt det. De har lätt pronation/naturlig löpstil.

:-)

Jag är glad igen! :-) Jag gillar mina kompisar och enda felet är att jag inte ringer dem tillräckligt ofta!

Mitt sinnestillstånd

Idag mår jag sämre än igår. Morsan tycker att jag borde gå och se en psykolog. Det kanske jag borde, eftersom jag mår dåligt idag. Men oftast mår jag inte dåligt. Dags att knäppa en öl till.... Sådär! Ölen förstör sexpacket som jag försöker bygga upp. Men det skiter jag i. Jag sprang 6.3 km i söndags och det är mycket. Jag har klarat mig själv hittills, i 25 år. Idag känner jag saker, det gjorde jag igår också. Kanske har livet omedvetet alltid sugit för mig. Igår sög det inte... Tror jag... KAN det inte ha gjort! Jag var på date med en skön brud, vi hånglade. Det var mysigt.

Om man har existentiell ångest bör man bli poet. Som Sarte och Gustav Frödig och Nils Ferlin. Jag skulle kunna skriva dikter. Tycker jag synd om mig själv nu? Svår fråga... Varför skulle det vara synd om mig?? Min inre röst säger att jag har mig själv att skylla. Men va fan, att tacka! För jag är grym på programmering, är en utmärkt ingenjör och snart även bra på tjejer. :)

Bla bla bla

Egentligen var det mitt eget fel. Knarkbrorsan är ett arsle. Kanske gjorde jag situationen värre genom att ringa. Men jag behövde säga vissa saker. Vissa saker jag undrat. Varför hände X och sedan Y? Vad satt emellan X och Y? Fattar inte övergången det är helt ologiskt ju. Jag är också ologisk ibland. Jag gillar att skriva skit för att få överblick. Jag har rätt att känna mig precis som jag vill. Att må dåligt, att vara lycklig, att vara bedrövad, att vara positiv, att le mot alla, att hälsa på okända grannar. Det är min frihet som människa. Krigiska människor. Psykisk ohälsa men jag har bara tänkt positiva tankar idag. Eller inte. OK nu är jag lugn. Jag mår bra. Familjen är jobbig mot mig. Jag tror att min mor vill mig väl men har stora psykiska problem. Skit samma, dags att titta Star Trek, sova, jobba imorgon.

Mer träning...

Igår torsdags sprang jag hela 6 km och rodde 2 km. De här uppdateringarna börjar bli lite tjatiga kanske. Men i framtiden vill jag kanske kunna se min utvecklingskurva. Tyvärr blev det tårta på jobbet, både på torsdagen och fredagen... Och två öl idag. Jaja. Tror iallafall att min form förbättras.

Det blev bättre igår

Sprang 5.5 km och rodde 2 km. Det är en liten förbättring mot förra resultatet. Appropå idrott och så, jag kan bara hålla med Erich Schubert vad gäller OS i Kina.

Slashdot

All my Slashdot points just ran out. I feel so empty inside. :(

Patch advertisement

Just advertising the patch at #103811. Actually it is an old patch from Søren Sandmann and I have just updated it to work with latest GTK+. It is an old patch but the smooth scrolling feature is so kick ass. It would GNOME look so much better.

Python-devvers rock!

I don't know exactly why, but this thread made me really happy and warm inside. :) The people developing Python are the most pleasant free software developers imaginable.

GtkImageView 1.6.1

I probably should go to sleep but I have to blog about it. I just released GtkImageView 1.6.1 and PyGtkImageView 1.1.0. It almost was a perfect release except that Epydoc failed to generate a PDF for the Python documentation. I hope Jeffrey is about ready to release the Perl bindings and then hopefully Andreas will also make some nice gtkmm bindings.

All in all, GtkImageView is quite mature now. Time for me to think about the next step... I'd like to replace the GdkPixbuf backend with Cairo. Then I'd make a totally kickass painting application out of it.

Good job Björn! Now I'm done.

Awesome!

Jag känner mig ganska nöjd med mig själv. Sprang 3.75 km och rodde 2 km på gymmet idag. När jag spänner magmusklerna kan man precis urskilja början till rutor. Men det är en hel del magfett kvar. Resten fixar jag imorgon eller på tisdag. Helgens diet bestod mest av chips, jordnötsringar och blåbärspaj så jag har en del att ta igen. Fan vad magen blir konstig av chips. Det måste vara något konstigt vegetabiliskt fett i det som jag inte tål.

Speciella grejer på nätet

Hittade min "rivals" hemsida igår. Den var ganska cool. Många speciella intressen och mycket information, men även Slashdot! :) Apropå andra intressanta saker, Svenska Spårvägssällskapets Forum slår det mesta med hästlängder. Att få läsa sådana här trådar gör mig glad i hela kroppen.

Bloggarkiv