Things to think about when tuning libtorrent for high performance

An user on the libtorrent mailing list had the following problem:

I’m doing some testing for a libtorrent application that will use a small number of peers (often just 1 seed and 1 downloaded) and high bandwidth delay product links (in the hundreds of Mb/s and 100ms+ round trip). I’m unable to get more than 20Mbps with a single peer on a 140ms RTT link (simulated delay with no packet loss). If I take the network simulator delay down to 0, I can get almost a full 1000Mbps on the same system. I’ve tried playing with everything that sounded relevant in session_settings, but nothing seems to make any improvement at all.

Is this the best that can be expected out of uTP on a high latency link? Or is there some combination of parameters that would improve the single peer throughput? Alternatively, is there a way to get libtorrent to make multiple connections between the same 2 peers?

If you’re facing a similar situation here are some things you could adjust according to Arvid Norberg lead engineer of the libtorrent project.

“Did you increase the socket buffer sizes on both ends?”

int recv_socket_buffer_size;
int send_socket_buffer_size;

“There’s also buffer sizes at the bittorrent level:”

int send_buffer_low_watermark;
int send_buffer_watermark;
int send_buffer_watermark_factor;

“And there are buffers at the disk layer:”

int max_queued_disk_bytes;
int max_queued_disk_bytes_low_watermark;

If the performance issue happens with uTP but not TCP though, it’s probably
just the first ones that matters.

Also, the uTP implementation needs a system call for each packet sent and
received (i.e. it does not use sendmmsg()/recvmmsg()) which also makes it
more expensive than TCP, but that would primarily cause additional CPU
usage, and only slow-downs once a CPU core is pegged.

Geek T-Shirt Collection #14 – FrostWire

This is the official FrostWire T-Shirt. I contribute to this open source project to keep my java skills up to date. We had a lot of these t-shirt printed to gather donations for the project. Thanks to the people that support us there’s only a few left (only M size) so Get your T-Shirt and support FrostWire.

What is FrostWire (According to Wikipedia)
FrostWire is a peer-to-peer file sharing program for the Gnutella and BitTorrent protocols. FrostWire is written in Java, and is a fork of LimeWire, another popular Gnutella client. Released under the GNU General Public License, FrostWire is free software.

See the Next T-Shirt
See the Previous T-Shirt

Powr.Proccoli-Kopimi – The Pirate Bay Manifesto

100 roads to #g-d:
001. Obtain the Internet.

002. Start using IRC.

003. Group and birth a site.

004. Experiment with research chemicals.

005. Design a three-step program.

006. Take a powerful stance for something positive and essential.

007. Regulate nothing.

008. Say that you have to move in two weeks, but stay for seven months. Come back a year later and do it all over again.

009. ROTFLOL.

010. Relax, you’re already halfway there.

011. Just kidding.

012. Don’t think outside the box.
Build a box.

013. Support support.

014. Organize and go to parties and fairs.

015. Start 30–40 blogs about the same things.

016. Drain the private sector of coders, graphic artists and literati.

017. Create a prize that is awarded.

018. Express yourself often in the media, vaguely.

019. Spread all rumors.

020. Seek out and try carding, and travel by expensive trains. Don’t order sushi.

021. Start a radio station.

022. Everything you use, you can copy and give an arbitrary name, whether it’s a news portal, search engine or public service.

023. Buy a bus.

024. Install a MegaHAL.

025. Make sure that you are really good friends with people who can use Photoshop, HTML, databases, and the like.

026. Read a shitload of philosophy.

027. Give yourself cult status, and act accordingly.

028. Never aim.

029. Pick on everyone.

030. Invent or misuse Kopimi.

031. Do things together as a composition, not as a collective.

032. Make your advertising confusingly similar to that of established ventures.

033. Always act with intent.

034. Assert, in any context, that the establishment is lagging.

035. When criticized, blame others and refer to the cluster formation’s non-linear time-creating swarm hierarchy.

036. Send everything to all media, regardless of niche.

037. Start an anonymous confession venture.

038. Make babies and blog their upbringing.

039. Be sure to closely study and keep abreast with substances.

040. Participate in lively Internet discussions that don’t interest you.

041. Start at least three to four IRC channels about every project.

042. Fight and make up often.

043. Share files with anyone who wants them.

044. Deal often with humor sites.

045. Hang out with the Left, the Right, and the Libertarians.

046. See “23” in everything.

047. Flirt with money.

048. Be AFK very little.

049. Threaten large American culture corporations.

050. Broadcast radio from Skäggetorp.

051. Make a “100 list” for successful projects.

052. Be unsure what the list should be named.

053. Take upon yourself a lot of projects.

054. Make sure to be connected to technical, aesthetical, and philosophical people of world class competence.

055. Sleep over at each others houses regularly.

056. Publish a book about Kopimi.

057. At a trial, deny everything.

058. Cultivate unfounded myths and react to them.

059. Hack sites, e-mail accounts, and more.

060. Continuously mock and ridicule all aspects of copyright.

061. Create an Internet site where people can buy and sell votes in democratic elections.

062. Claim to be true, fair and satisfied.

063. Collect money for fraux’s trip to Iceland.

064. Confidently claim that all disconnected computers are broken.

065. Do NOT go to Kurdistan.

066. Make sure to thoroughly establish the claim that all hardware is overpriced.

067. Affirm all words and signs.

068. Mindfuck each other to appropriate extent.

069. Take care of small animals.

070. Create and spiritualize the concept of “Snel hest.”

071. Start and own a think-tank.

072. Deny magnetism.

073. Start a business school. Drop out.

074. Write press releases often.

075. Use IRC while in your underwear, and eat pizza.

076. Juggle with other people’s balls.

077. Ensure that there is no conclusive evidence of Ikko giving monki advertising money by means of volada’s helicopter.

078. Cause inflation and a global financial crisis.

079. Express yourself vaguely if anyone asks you, “How much is a bandwidth?”

080. Use “dynamic” to mean “completely out of control”.

081. Never mention Hotmail, MSN, or Windows.

082. Have all project meetings on IRC.

083. Claim to receive around 1256 e-mails a day.

084. Force a prosecutor to draw up several thousand pages of drivel.

085. Above all abstract everything.

086. Have a liberal vision of hell.

087. Consider yourself overly qualified for top positions in American film and music industries.

088. Create the world’s largest file-sharing service in a twinkling.

089. Attract international attention by accident.

090. Control the portal and opinion makers in all mediums.

091. Standardize and explain your way of doing things at all levels.

092. Have 3576 anonymous confessions on your hard drive. Including the authors’ IP addresses and personal information.

093. Preserve the Internet.

094. Mention the Internet as a source in serious discussions.

095. Rarely mention reasons for your IT elitism.

096. Dismiss expressions like “from farm to table” as superstition.

097. Follow the yellow fellow.

098. Skip the last points of your 100 point list.

099. Establish social services as a parody of antisocial services.

100. Start from scratch.

100. Be careful of burning kittens.

100. Write a book, but start with the back cover.

100. Use parables in abundance, preferably about “butter” and “snow”.

100. Stop using IRL. Use AFK instead.

100. Cultivate contacts within the powers of state intelligence services.

100. Always define “flat organization” arbitrarily, subjectively, and without common sense.

100. Upload.

100. Take over #g-d.

100. PROFIT.

Reblog this post [with Zemanta]

Unsigned band breaks into top 20 most shared music on the planet

From Georgia Wonder:

London, UK: Georgia Wonder, an unsigned British band, climbed into the top 20 most shared music in the world last weekend, reaching 14th position in just four days with their debut EP ‘Hello Stranger’.

The EP was put onto the Pirate Bay tracker on Wednesday 14th January and by Saturday 17th was the only music in the top 100 from an unsigned artist. The EP of five songs, which the duo released themselves last year, hit the Pirate Bay Top 20 on Saturday evening and peaked at the 14th position in the early hours of Sunday morning. The Pirate Bay is the worlds largest tracker of shared files.

The band were able to propel their music into well over 50,000 homes across the world in just a few days after making their EP readily available to download from the welcome page of the Limewire software offshoot ‘Frostwire’.

“What Frostwire helped us achieve is incredible” explained Stephanie Grant, vocalist with Georgia Wonder. “Their support has put our music into the hands of tens of thousands of potential fans in a matter of days. 40 billion songs were shared online last year – that’s 6 songs for every person on earth. You can imagine what just five days in the top 20 means to a relatively unknown band like us.”

“We met the Frostwire guys on Twitter” said Julian Moore, the other half of Georgia Wonder. “I’d recently dusted off our Twitter account after hearing that British celebrities such as Jonathan Ross and Stephen Fry had become avid users, and after a few weeks we got chatting to the Frostwire team. They were really keen to let us try their new approach to band promotion and as we were already letting people share our music on Twitter we agreed to give it a shot. I’m so glad we did!’

Pirate Bay, the world’s largest BitTorrent tracker has repelled many unsuccessful attempts to shut it down over the last few years including a police raid in 2006 and bitter disputes with a variety of music and media companies in 2007. “It’s easy to forget that while the major record labels and anti-copyright groups have been taking high-profile shots at each other there are a lot of independent artists out here who are simply trying to navigate their way through the wreckage” said Julian. “Our success with Frostwire proves that you can cut through the argument and chart your own course.”

About Georgia Wonder

Georgia Wonder played in front of over 14,000 people for Simply Red frontman Mick Hucknall on his UK tour and performed at an historic election night at the London American Embassy alongside Glenn Tilbrook from Squeeze. Their song ‘Girl You Never Knew’ from their debut EP ‘Hello Stranger’ has been on rotation on Bliss TV for six months and has received plaudits from Record Of The Day and Pop Justice who called it ‘..one Grey’s Anatomy soundtrack appearance away from being an international hit single.’ They were recently nominated for an interactive award at Eurosonic and won best video in the rock category on OurStage.com in November ’08 for their song ‘Would Love To Meet’. Originally picked up by legendary BBC presenter ‘whispering’ Bob Harris who played their demos for two concurrent weeks on his BBC Radio 2 show, they have performed live on BBC Southern Counties, BBC Radio Solent, Original FM and a host of other regional radio stations.

–ENDS–

Contact

Julian Moore
julian at gwonder dot com

References
Pirate Bay Snapshot 18/1/09

40 Billion Songs Shared Online

Links

Georgia Wonder Website

Frostwire

‘Hello Stranger’ EP Torrent on Pirate Bay

Reviews

Record Of The Day

Record Of The Day – Record Of The Week

Pop Justice – Song Of The Day

Matt Pond PA offers his newest EP ‘The Freeep’ Free through Frostwire

From Frostclick.com

Download Torrent

mattpondpa.com

Matt Pond PA (commonly typeset as matt pond PA, or mppa for short) is an indie band formed in Philadelphia, Pennsylvania in 1998 by singer/songwriter Matt Pond. Throughout the years the band released 7 albums, 9 EPs and played with artists like Ted Leo and the Pharmacists, Youth Group, Nickel Creek and Mae.
Continue reading

Unsigned Musician Sean Fournier Draws Over 25,000 Downloads in One Weekend

FrostWire™ is positively on the news this morning showing how P2P can achieve great things when artists have an open mind when it comes to sharing some of their work for free.

As of FrostWire™ 4.17.0, we can promote legal content, or important information using the FrostWire™ welcome screen. We’ve vowed to never use this screen for spam or evil purposes of any kind, only to help content creators of all kinds (musicians, film makers, writers, software programers, photographers, video game shops and independent professionals) that are willing to share some of their work for free, or under creative commons licenses get their message across our ever growing network.

Sean Fournier is the first musician to do so, in only 4 days his 6 track album “Oh-my” was shared via FrostWire™ by over 25,000 users, at the time of this writing the download count by the torrent tracker is 27,923, saving Sean almost 1 Terabyte of data sent, plus having his music on tens of thousands of computers and who knows into how many portable music players.

You can read the full story on FrostClick.com, our initiative towards the distribution of 100% free and legal content over FrostWire™.

Here’s a press release we found this morning on the news:

Milford, CT (PRWEB) December 2, 2008 — Musician Sean Fournier harnesses the power of Peer-to-Peer networking to distribute his free album, ‘Oh My’, to hundreds of thousands all over the world via FrostWire’s welcome screen. Within the first weekend, this exposure returned over 25,000 complete downloads for this independent singer/songwriter.

sean_fournier_featured_frostwire_torrent_download
FrostWire Welcome Screen Featuring Sean Fournier

Spread it like the plague.
Fournier’s ‘Oh My’ is the first free album download to be featured on FrostWire’s Welcome Screen, which is a new feature designed to help musicians and content owners share their media for free on the FrostWire network.

‘Oh My’ is a six-track album which was created to be 100% free. Sean encourages his listeners to download it, share it, give it friends and family – and do anything within their power to “Spread it like the plague.”

Aside from it’s recent exposure on FrostClick.com, listeners can get their hands on ‘Oh My’ at Sean Fournier’s Official Website.

If you’re a professional content creator willing to share some of your work for free to get more exposure and thus increase your sales, contact us at FrostClick.com

Related Links

Sean Fournier’s Blog – FrostWire related Post #1

Sean Fournier’s Blog – FrostWire related post #2

FrostClick.com – Sean Fournier’s “Oh My” – A great Free Album

Cows also share

User luisdrk from Caracas,Venezuela has posted this picture on flickr. Pretty cool stuff. it’s actually a parody of this picture by Jesus Molina.

It’s really funny because we had our inspiration from a similar source, we looked for the words “frost wire” in flickr, and we saw frozen barbed wires, this is the one that caught our eye and then we talked to a great graphic designer who did the logo for us.

Reply with your creations on this post’s comments section.

What’s new in FrostWire 4.13.5

FOR IMMEDIATE RELEASE:

FrostWire 4.13.5 is now available for MS Windows, Mac OSX and Linux. Major updates improve network bootstraping and peer discovery. 4.13.5 includes improvements on the Chatroom tab, Audio Previews and more.

Other improvements have taken place for the FrostWire build process (for developers this means true One-Step builds for all versions). Updates on translations have been made thanks to the feedback from users in Poland and throughout Latin America. .

In more detail users can expect the following:

  • Faster peer discovery on connection bootstraping. No more “Starting Connection…” problems, first time users will connect faster without using the official FixConnecting.zip patch.
  • Smiley Support to the chatroom

Users can see the available smileys by entering the command
/smileys

Now its possible to see and use Smileys from the Community Chat tab, Smiley display can be enabled or disabled from the view menu:

Show Smileys

Users can also toggle Smiley display directly from the chat window by typing the command
/tsmileys

  • Fixed wording on Spanish and Polish translations.

Bug Fixes and other improvements for this release also include:

  • FrostWire Message Update System improved. Per community request, some announcements will not be shown more than once so the user is not annoyed upon every application launch
  • Fixed bugs on the media player and playlists on Preview.
  • Fixed bug on search box auto-focusing while a search was running.
  • Fixed i18n system error for systems which default language is not english
  • Potential bugs related to deprecated code gone

Users can find now by details without the auto-focusing problem.

FrostWire 4.13.5 is expected to be the last of the 4.13.x series.

About FrostWire

FrostWire, a Gnutella Peer-to-Peer client, is a collaborative effort from many Open Source and freelance developers located from all around the world. In late 2005, concerned developers of LimeWire’s open source community announced the start of a new project fork “FrostWire” that would protect the developmental source code of the LimeWire client and any improvements to the Gnutella protocol design. The developers of FrostWire give high regard and respect to the GNU General Public License and consider it to be the ideal foundation of a creative and free enterprise market.