Domino 6.5 EOL

Search

Languages

Other languages on request.

About Me

I am the "Lotus Technology & Productivity Advisor" for IBM Asia Pacific. I'm based in Singapore.
Reach out to me via:
Follow notessensei on Twitter
Yahoo IM
Skype
Sametime
IBM

Twitter

Ads by Google

Visitors

« I want one - 2009 Part 1 | Main| How to explain "What is Server Virtualization" »

Building a high performance Domino Server

QuickImage Domino can take huge user populations. To do this successfully all elements of a Domino server have to be considered carefully. Following the old insight "It is always the cable" you need to pay attention to the hardware layout. While you perfectly well can install a Domino server on a low-end laptop or a VM Image, it wouldn't give you the peak performance you are looking for. You rather want something looking like this:
Server layout for a high performance Domino server
Let us look at the details:
  • Disk layout
    • Operating system and Applications: This is your first RAID 1 Array. Since data hardly change and are really not that much a small but fast spinning drive will do. RAID1 protects you against failure of one drive and speeds read operations. Some suggest to have separate drives for application and OS, but that might be overkill. You could consider having separate partitions (easy on Linux/Unix).
    • View Rebuild Directory: There is a nice notes.ini variable View_Rebuild_Dir. You can point to a separate drive to store the temporary files created during index updates. The default is the system temp directory. This directory is a good candidate for a RAM disk or a solid state disk when your system is updating a lot of views all the time.
    • Domino Data: Typically you have a RAID5/RAID10 storage here to accommodate the large amount of data (users demand Google size mailboxes and your applications don't shrink magically). More and more we do see SAN systems for Domino storage, which is OK. Just keep in mind: Don't store Domino cluster databases from different clusters in the same SAN since it defeats the idea of a share-nothing cluster. While we support the use of NAS, the network latency and bandwidth is a limiting factor. Archival servers run fine with NAS, but not your high performance primary production server.
    • Transaction Logging: You have tried it. Switched it on, expected great things and it didn't perform. The flaw: for good transaction logging performance you need your own disk. Not just another partition, but your very own spindle (RAID1) ideally with its own controller. It would be interesting to see how solid state disks work here.
  • Network layout
    • Cluster Replication (If you cluster your server only): You want to have your cluster on its own network segment. If you have 2 boxes next to each other a cross-over cable would do (afaik 1GB Ethernet requires a hub). If your go three-way (highly recommended), then a hub and an IP address segment that doesn't get routed will do.
    • Server Network: All servers should be connected on the server backbone. Put them into their own subnet clients can't see. Replication never gets disrupted by clients jamming the network ports. The server network also handles mail routing.
    • Client access: If you have huge numbers of clients you might reach the physical capability of your network card or the TCP/IP stack. Use more than one card and/or more than one IP address to have sufficient ports available for clients to connect.
Of course all of this isn't new (except the shiny picture), you can read much more details on IBM's Domino Performance Best Practices pages. This is just about the hardware layout. You need to consider the operating system too. But that's a story for another time. As usual YMMV.
Update: There is now addtional material available how to tune an IBM System x server to peak performance. Update 2 Samir points to a nice comparison between RAID5 and RAID10. It's not Domino related but insightful. One key point there: watch your controller.

Comments

Gravatar Image1 - Shame most standalone servers only allow a max of 8 drives ;)

I guess you really do need a SAN for a high performance setup.

Gravatar Image2 - FYI: It is possible to build a cross over cable for gigabit ports: { Link }

Gravatar Image3 - @Darren High performance SAN is only possible if the SAN people give you what you ask for. This is the second position I have found that they give you want they want to give you, not what you ask for.
In the end it is just under performing storage.

Gravatar Image4 - @Selcuk: Thx for the link, learned something

@Darren: put the RAID5/10 in an external casing just below your Domino.

@Jim: Jep. Known problem.

Gravatar Image5 - Don't forget your DAOS repository!!

Gravatar Image6 - Hi Stephan, good post. I would add two things and that is multiple Domino Partitions especially now with Windows 64 bit support and DIR links to move some lesser used DB's to cheaper and slower storage like a single big SATA drive. Did you know you can use DIR links for the mail boxes as well? All you do is create a text file called mail1/2/3/4/etc.box and inside the file point it to the actual location. Emoticon

Gravatar Image7 - My recommendations have been the same for years now. Direct-attached external cabinet rather than SAN, and the fastest spin rate available for the drives. Multiple controllers if possible, too. And these days I'm recommending either RAID-10 for the data array, or RAID-6 -- with RAID-10 for the best performance or RAID-6 for the best combination of performance and reliability.

I'm also interested in the idea of solid state drives for Domino servers, and given their performance advantages I'm wondering if it would be ok to combine transaction log, view rebuild and transaction logs on one large solid state device. There's no head movement to worry about, so I suspect that mixing the sequential i/o of the translog and the random i/o of the view rebuilding would be ok.

Gravatar Image8 - I find myself very cynical to SAN's these days. Hard to justify, especially for Domino considering the active active clustering model.

Aside from that, all is great there sir

Gravatar Image9 - This is exactly what I recommend my customers. Since 8.5 I also add a separate DAOS RAID5/SAN. Emoticon

It's just that some customer do not want to invest in these large servers anymore, but use SAN for all storage. This is where I warn them to get the right SAN configuration, or else... Emoticon

Gravatar Image10 - Anyone experienced performance with Solid State Drives allready?

Post A Comment

Please note: Comments without a valid and working eMail address will be removed. This is my site, so I decide what stays here and what goes.

:-D:-o:-p:-x:-(:-):-\:angry::cool::cry::emb::grin::huh::laugh::rolleyes:;-)

Disclaimer

This site is in no way affiliated, endorsed, sanctioned, supported, nor enlightened by Lotus Software nor IBM Corporation. I may be an employee, but the opinions, theories, facts, etc. presented here are my own and are in now way given in any official capacity. In short, these are my words and this is my site, not IBM's - and don't even begin to think otherwise. (Disclaimer shamelessly plugged from Rocky Oliver)

© 2003 - 2010 Stephan H. Wissel - all rights reserved as listed here: Creative Commons License
Unless otherwise labeled by its originating author, the content found on this site is made available under the terms of an Attribution/NonCommercial/ShareAlike Creative Commons License, with the exception that no rights are granted -- since they are not mine to grant -- in any logo, graphic design, trademarks or trade names of any type.

Get Firefox Use OpenDNS