jhb is currently certified at Master level.

Name: John Baldwin
Member since: 2000-03-27 04:05:54
Last Login: 2007-01-21 04:57:11

FOAF RDF Share This

Homepage: http://www.FreeBSD.org/~jhb/

Notes:

I actively work on the FreeBSD project. Currently I'm working on making the kernel use somewhat fine-grained locking to improve our SMP performance. However, the effort is being spent right now on getting our primitives and basic structure in place more than on actually pushing down the locks. I still do a little work on the x86 bootstrap as well. I also maintain a couple of ports and parts of the documentation, as well as the occasional userland fix.

Projects

Recent blog entries by jhb

Syndication: RSS 2.0

Gee, been a long time since I added a diary entry here. Such is life I suppose. My last entry noted that I was starting at BSDi/WC in the following week. Since then things have changed slightly since BSDi's software side was acquired by WindRiver after a somewhat bumpy ride, and today I type this entry while people run around packing up the last of their things in preparation for the move to WRS's Alameda facility tomorrow. Most of the engineering group from the Concord office has already moved, but a few of us held out until tomorrow's move. Personally, I wanted to keep my 2 minute reverse commute for as long as possible.

As far as my work in FreeBSD, it has changed rather dramatically in the past year or so. Last year I was a documentation committer sneaking into the coding side of the tree by way of the x86 bootstrap code and scheduled to work on the ia64 bootstrap. A few weeks after I arrived at Concord, most of the engineering project left for the big SMP meeting to talk about FreeBSD's SMP next generation project to multithread our kernel. I didn't attend the meeting, read the summary e-mail on the list with little interest, and didn't bother to read any of the slides posted.

About three months later, I was stuck working on a relatively boring contract job when Greg Lehey wandered into the BSD coding IRC channel asking for help with some problems he was having getting interrupt threads stable on a UP x86 kernel. Once I finally got the contract job done (somewhat time-crunched due to working on the SMP stuff every once in a while) I turned to the SMPng project full time and ported the new ithreads to SMP x86 and to the alpha. Since then I have been working on the SMPng project full time in various areas of the kernel. Rest assured that I am not doing this alone however (thank goodness). I suppose one's diary can give a false exaggeration of one's own accomplishments relative to other people's. Anyways, several things have changed in the FreeBSD kernel since the SMP project have changed, and several more changes are slated to come. However, there is the "small" roadblock of 5.0 release scheduled for late November. Couple this with the fact that despite all the progress that has been made, the kernel is still about 95+% under the Giant lock, and it seems that 5.0 is scheduled for a performance nightmare. While people seem to accept that 5.0 will suck, they really want 5.1 to not suck quite so badly, and for 5.2 to be both stable and at least as decent performancewise as 4.x. While I can agree that these are reasonable requests from our customers point of view, I am afraid that there is just not enough manpower and time to get there. However, those release dates are still quite a ways off, and we might be able to pull it off yet.

For those curious about the current work on SMPng, I'm presently working on making the kernel fully preemptive. That is, we will preempt to a process in setrunqueue if it is a higher priority process. This is rather different from the standard behavior of the Unix kernel, but this is the direction most (if not all) successful multithreaded Unix kernels have gone. It also greatly simplifies some pieces of code with respect to synchronization primitives and removes several opportunities for programmer error.

As far as non-code work, I'm planning on giving a paper at BSDCon that serves as a tutorial/guide on how to do data locking to help educate the developerbase about the new world order in the FreeBSD kernel. I will also probably use this paper to flesh out the Locking Notes chapter in the FreeBSD Developer's Handbook. Also, I'm planning on giving a talk about the Witness lock order verifier at the Usenix ATC in 2002. I may attempt to port it to userland as a wrapper around pthreads, but I'm not sure about that yet.

Well, it has been a while since I've added an entry, so I'll start off with several updates.

  • First, I did get the USB install stuff finished and committed to -current. I hope to MFC it in time for 4.1 release. Currently, we have problems with USB keyboards during install as follows:

    • USB keyboards on the x86 arch can't be used in installation because the kernel userconfig only works with AT keyboards. The solution is to make userconfig MI and move it into the loader, which is now a WIP.

    • USB keyboards on the alpha arch should work, except that I haven't enabled USB in the GENERIC kernel yet, and SRM doesn't support a USB keyboard.

  • PXE support is now done and committed to both -current and -stable. We used a polling method of reading packets, removing the need for ISR hooks in BTX, so the support for ISR's in BTX was dropped.

  • Automagical LBA/EDD support in the bootstrap is still on the todo list.

  • I graduated May 13 (11 days ago).

Now that school is over, it's time to start work. I've got a job with BSDi out at the WC office (former home of WC CDROM) and will be starting that in a couple of weeks. I'll be spending most of next week driving across the country to get there. Once I do get there, I still have to find an apartment, and will then turn around and head down to Usenix with the rest of the gang.

In other FBSD news, we now have the latest and greatest version of binutils, including a gas(1) that actually groks 16-bit x86 assembly. As such, I've been on a rampage recently going through and cleaning up all the old 16-bit code in the bootstrap to be actual assembly now w/o faking the arguments or using M4 macros to work around deficiencies.

Well, I finally got my final, cleaned-up version of the PXE boot loader for FreeBSD tested. With that out of the way, I committed all my current patches to the boot loader, cleaning up some things, and adding PXE support. Next up on the todo list for the loader is to add support in the BTX environment for hooking hardware interrupts. Client apps will register an ISR that I call at PL3 like the rest of the application. This way the ISR can be written in C and use the same vm86 entry points as the rest of the loader. I also have another set of patches to look at to detect the int 13 EDD extensions and turn on LBA support automatically in the loader. I plan on merging similar functionality into the other stages of the boot process so that LBA support will no longer have to be manually enabled after installation.

In other news, my latest USB-install release is broken due to silliness on my part. The end result is a kernel that has no console device and thus can't perform any I/O when it tries to boot. Now that I have tracked this silly typo down, I am waiting for the recent world breakge to be fixed so that I can roll another test release. Thankfully, almost all of my changes to enable USB support in the installation floppies can be merged easily into the main installation floppies. However, USB keyboards do not work with the kernel's userconfig utility. Thus, the INSTRO_USERCONFIG option cannot be compiled into the USB boot floppy's kernel. As a result, it looks like we will have to have a seperate kern.flp image for systems with USB keyboards until userconfig can be moved out of the kernel and into the loader.

47 days to graduation now; I can't wait.

 

jhb certified others as follows:

  • jhb certified dcs as Journeyer
  • jhb certified eivind as Master
  • jhb certified unfurl as Journeyer
  • jhb certified dwhite as Journeyer
  • jhb certified nsayer as Journeyer
  • jhb certified cmc as Journeyer
  • jhb certified jhb as Journeyer
  • jhb certified cg as Master
  • jhb certified will as Journeyer
  • jhb certified gsutter as Journeyer
  • jhb certified kkenn as Journeyer
  • jhb certified jwz as Master
  • jhb certified darius as Journeyer
  • jhb certified benno as Journeyer
  • jhb certified nik as Master
  • jhb certified imp as Master
  • jhb certified anders as Apprentice
  • jhb certified dhagan as Apprentice
  • jhb certified jmg as Journeyer
  • jhb certified asmodai as Journeyer
  • jhb certified rwatson as Master
  • jhb certified keichii as Apprentice
  • jhb certified phk as Master
  • jhb certified jmock as Journeyer
  • jhb certified obrien as Master
  • jhb certified mph as Journeyer
  • jhb certified billf as Journeyer
  • jhb certified softweyr as Master
  • jhb certified k as Journeyer
  • jhb certified winter as Journeyer
  • jhb certified msmith as Master
  • jhb certified jedgar as Journeyer
  • jhb certified grog as Master
  • jhb certified ashp as Apprentice
  • jhb certified green as Journeyer
  • jhb certified peter as Master
  • jhb certified nbm as Journeyer
  • jhb certified des as Journeyer
  • jhb certified bp as Journeyer
  • jhb certified jkh as Master
  • jhb certified bmilekic as Journeyer
  • jhb certified eric as Apprentice
  • jhb certified kappa as Apprentice

Others have certified jhb as follows:

  • jhb certified jhb as Journeyer
  • cmc certified jhb as Journeyer
  • dcs certified jhb as Master
  • benno certified jhb as Journeyer
  • eivind certified jhb as Journeyer
  • will certified jhb as Master
  • gsutter certified jhb as Journeyer
  • imp certified jhb as Journeyer
  • dhagan certified jhb as Journeyer
  • asmodai certified jhb as Journeyer
  • rwatson certified jhb as Journeyer
  • billf certified jhb as Journeyer
  • softweyr certified jhb as Journeyer
  • cg certified jhb as Journeyer
  • phk certified jhb as Apprentice
  • winter certified jhb as Journeyer
  • mph certified jhb as Journeyer
  • jedgar certified jhb as Journeyer
  • green certified jhb as Journeyer
  • peter certified jhb as Master
  • bp certified jhb as Journeyer
  • thallgren certified jhb as Journeyer
  • higb certified jhb as Journeyer
  • bmilekic certified jhb as Journeyer
  • nixnut certified jhb as Journeyer
  • gelderen certified jhb as Journeyer
  • jmg certified jhb as Journeyer
  • gjvc certified jhb as Master
  • kappa certified jhb as Master
  • monk certified jhb as Master
  • fxn certified jhb as Master
  • zwane certified jhb as Journeyer
  • anholt certified jhb as Master
  • dyeske certified jhb as Master
  • rnsanchez certified jhb as Master
  • jblnyc certified jhb as Master
  • delphij certified jhb as Master
  • infofarmer certified jhb as Master
  • bsdgabor certified jhb as Master

[ Certification disabled because you're not logged in. ]

New Advogato Features

New HTML Parser: The long-awaited libxml2 based HTML parser code is live. It needs further work but already handles most markup better than the original parser.

Keep up with the latest Advogato features by reading the Advogato status blog.

If you're a C programmer with some spare time, take a look at the mod_virgule project page and help us with one of the tasks on the ToDo list!

X
Share this page