tag:blogger.com,1999:blog-77814712896247639772016-09-29T00:56:25.162-07:00Analytic CombinatoricsA blog dedicated to analytic combinatorics and the book with that same title, by Flajolet and Sedgewick, which appeared in January 2009
[Cambridge University Press, UK; ISBN: 978-0-521-89806-5].Philippe Flajolethttp://www.blogger.com/profile/09919304763324375717noreply@blogger.comBlogger2125tag:blogger.com,1999:blog-7781471289624763977.post-30249370197801968862009-07-29T05:20:00.000-07:002009-07-29T09:05:00.718-07:00How many errors does this book contain?<p><br />That's a question every author anxiously asks him/her/itself, as soon as the manuscript goes to press. Well, here is what happened regarding the Little Purple Book. By the way, the current list of errata appears on the <a href="http://algo.inria.fr/flajolet/Publications/AnaCombi/">Book's Page</a>.<br /><br />As errors and typos were being communicated by readers and carefully recorded, it appeared that it took till the thirtieth (30th) notification before a typo was reported <em>twice</em>. What does this tell us about the total number <math><span class="Apple-style-span" style="font-style: italic;">N</span></math> of typos in the book?<br /><br />Naturally, <math><span class="Apple-style-span" style="font-style: italic;">N</span></math> is unknown. Assume that errors are reported uniformly at random. You'll recognize now a case of the well-known "birthday surprise" (also known as "birthday paradox"). Namely, on Earth (where <math>N</math>=365), it takes about 23 persons (on average, or with probability larger than <math>1/2</math>) to obtain a sample where two people will have the same birthday. Now, our problem with estimating the number of errors in the book is of the same nature, but with a year that would have<span class="Apple-style-span" style="font-style: italic;"> </span><math><span class="Apple-style-span" style="font-style: italic;">N</span></math> days, instead of 365. The answer is as follows: the number of persons it takes to first obtain a colision of birthdates is on average approximately <math>sqrt{pi N/2}</math>. A discussion can be found on pages 114-115 of <em>AC</em>; this problem is a nice illustration of the power of exponential generating functions.<br /><br />Let us say we observe that the first collision occurs on the <math><span class="Apple-style-span" style="font-style: italic;">r</span></math>th trial. Then, we equate <math>sqrt{\pi N/2}</math> with <math><span class="Apple-style-span" style="font-style: italic;">r</span></math>, and cleverly "deduce"(!) that <math><span class="Apple-style-span" style="font-style: italic;">N</span></math> should be approximately <math>2<span class="Apple-style-span" style="font-style: italic;">r</span>^2/pi</math>. Fair enough, eh? With <math><span class="Apple-style-span" style="font-style: italic;">r</span>=30</math>, this predicts a number of errors of the order of 600 (the exact solution is 572.95...).<br /><br />If we actually simulate the experiment, fixing the number <math><span class="Apple-style-span" style="font-style: italic;">N</span></math> of errors, we find that this formula does predict the rough order of magnitude of <math><span class="Apple-style-span" style="font-style: italic;">N</span></math>, but with a systematic multiplicative bias. What is going wrong here?<br /><br />The problem is that the expectation of a square and the square of an expectation are not the same thing. Here, analysis teaches us that the expectation of the square of the time it takes to reach the first collision is asymptotic to <math>2<span class="Apple-style-span" style="font-style: italic;">N</span></math><span class="Apple-style-span" style="font-style: italic;">.</span> Thus the "right" (i.e., asymptotically unbiased) estimator is in fact <math><span class="Apple-style-span" style="font-style: italic;">r</span>^2/2</math>. See <em>AC</em>, Note VI.25, p. 417, for a discussion. This leads us to infer that we should expect the actual number of errors in the Little Purple Book to be closer to 450, rather than the infamous 600. Soothing, isn't it?<br /><br />Of course, there are limitations. First, the statistical procedure is not very accurate: its accuracy can be gauged by estimating the expectation of the <em>fourth</em> power of <math><span class="Apple-style-span" style="font-style: italic;">r</span></math>, in itself a less trivial math exercise. Worse, we expect the figures, 450 and even 600, to be gross understimates since errors are not picked up uniformly at random --the ones closer to the beginning are more likely to be found than the ones in arcane corners of the book. So, a mistake per page sounds more like a reasonable possibility, and the book has 824 pages in total... Depressing!<br /><br />Where does the idea of such an estimator come from? I first heard it more than twenty years ago from Gilles Brassard, while he was preparing his book with P. Bratley on algorithms. In order to determine how many balls an urn has, repeatedly pick up a ball at random (shake the urn!), mark the ball just picked up (say, with a touch of paint), and repeat until an already marked ball surfaces. <span class="Apple-style-span" style="font-style: italic;">Return half the square of the number of steps.</span> Et voila! </p><div><br /><div>To be honest, till to-day, I couldn't think of a real case of application of Brassard's algorithm and I was viewing it mostly as a thought experiment, a <em>gedanken</em> experiment, as a physicist would say. Perhaps we have here the first actual use of Brassard's algorithm. At any rate, his sampling-based algorithm has pedagogical value: it demonstrates that you can really achieve something with sublinear resources. Refer to the many probabilisic stream algorithms that are now known, the current research on property testing, and so on.<br /><br /></div></div>Philippe Flajolethttp://www.blogger.com/profile/09919304763324375717noreply@blogger.com0tag:blogger.com,1999:blog-7781471289624763977.post-43542117813597569762009-06-24T08:47:00.000-07:002009-06-24T09:10:30.223-07:00Hi! After nearly a year of final adjustments, copy-editing, and production work at the Press, the book <e>Analytic Combinatorics</e> eventually became available in January 2009. Cambridge University Press has done a great job and our editor, David Tranah, was a great help, throughout the whole process.<br /><br />I'd like to remind everybody that, thanks to a special arrangement with CUP, we, authors, retain the non-exclusive copyright of the electronic edition. Thus, the manuscript continues to be <b>freely available to individual users</b> from the authors' home pages.<div><br />I plan to maintain a page with some goodies at the <a href="http://algo.inria.fr/flajolet/Publications/AnaCombi/index.html">book's URL</a>, from which the entire text (about 13MB in PDF) can be downloaded.</div><div><br /></div><div>In this blog, I hope to report on new results relative to <e>analytic combinatorics</e>, possibly discuss the choice of topics in the book and/or stories. Comments are also most welcome regarding the contents of the book and possible mistakes or oversights--we hope to have a new edition out some time in the future. It'd be nice also, if people who teach from the book were kind enough to drop a line here, possibly with a pointer to their home/course page.<br /><br /><br /><br /></div>Philippe Flajolethttp://www.blogger.com/profile/09919304763324375717noreply@blogger.com1