]>
git.sesse.net Git - remoteglot-book/log
Steinar H. Gunderson [Sat, 13 Dec 2014 00:09:06 +0000 (01:09 +0100)]
Use the new pgn-extract partitioning to get the file offsets right.
Steinar H. Gunderson [Fri, 12 Dec 2014 21:56:30 +0000 (22:56 +0100)]
Store and handle the PGN start position.
Steinar H. Gunderson [Fri, 12 Dec 2014 18:12:25 +0000 (19:12 +0100)]
Use GNU parallel instead of rolling our own (parallel-parse-pgn.sh is unchanged, though). Allows us to limit parallel binloader instances, since we have had some RAM issues.
Steinar H. Gunderson [Fri, 12 Dec 2014 18:11:15 +0000 (19:11 +0100)]
Make PGN partitioning work better with DOS-style line endings.
Steinar H. Gunderson [Fri, 12 Dec 2014 18:10:09 +0000 (19:10 +0100)]
Fixes for filenames with spaces.
Steinar H. Gunderson [Fri, 12 Dec 2014 01:16:12 +0000 (02:16 +0100)]
Fix a sort-of rare and silly castling bug.
Steinar H. Gunderson [Fri, 12 Dec 2014 01:09:20 +0000 (02:09 +0100)]
Key the table by position, not position+move. Makes for more complex exploration, but is generally much more sane (e.g. we can store root games for each position in the future).
Steinar H. Gunderson [Fri, 12 Dec 2014 00:06:51 +0000 (01:06 +0100)]
Switch value format to protobuf. Slightly smaller, easier to deal with extensions that will come soon.
Steinar H. Gunderson [Thu, 11 Dec 2014 23:01:31 +0000 (00:01 +0100)]
Parse timestamps from the binary format. Needs some rework, though.
Steinar H. Gunderson [Thu, 11 Dec 2014 19:51:38 +0000 (20:51 +0100)]
Change to even shorter prefix length; down from 3.8 to 3.1 GB (single partition is 3.0 GB).
Steinar H. Gunderson [Thu, 11 Dec 2014 19:21:21 +0000 (20:21 +0100)]
Fix inverted logic in the hash. Gets me every time.
Steinar H. Gunderson [Thu, 11 Dec 2014 19:02:26 +0000 (20:02 +0100)]
Make number of shards in build-book.sh a configurable constant.
Steinar H. Gunderson [Thu, 11 Dec 2014 18:55:22 +0000 (19:55 +0100)]
Partition the SSTable; somewhat less efficient space-wise, it seems, but we avoid the huge serialization step in the end.
Steinar H. Gunderson [Thu, 11 Dec 2014 18:51:11 +0000 (19:51 +0100)]
Remove leftover import from opening-stats.pl.
Steinar H. Gunderson [Thu, 11 Dec 2014 00:58:36 +0000 (01:58 +0100)]
Update .gitignore.
Steinar H. Gunderson [Thu, 11 Dec 2014 00:58:01 +0000 (01:58 +0100)]
Add an end-to-end build script.
Steinar H. Gunderson [Thu, 11 Dec 2014 00:57:46 +0000 (01:57 +0100)]
Drop parse-pgn.pl and use (our patched) pgn-extract.
Steinar H. Gunderson [Thu, 11 Dec 2014 00:36:00 +0000 (01:36 +0100)]
Add a small hack for the start position.
Steinar H. Gunderson [Thu, 11 Dec 2014 00:31:18 +0000 (01:31 +0100)]
Use the new opening data from pgn-extract.
Steinar H. Gunderson [Thu, 11 Dec 2014 00:00:47 +0000 (01:00 +0100)]
Add some shell magic to split a PGN file into almost equal pieces.
Steinar H. Gunderson [Wed, 10 Dec 2014 23:55:31 +0000 (00:55 +0100)]
Fix some paths after git rewriting.
Steinar H. Gunderson [Wed, 10 Dec 2014 00:44:06 +0000 (01:44 +0100)]
Clean up module usage in parse-pgn.pl.
Steinar H. Gunderson [Wed, 10 Dec 2014 00:39:49 +0000 (01:39 +0100)]
Remove now obsolete Postgres support.
Steinar H. Gunderson [Wed, 10 Dec 2014 00:27:56 +0000 (01:27 +0100)]
Now make sorting click both ways.
Steinar H. Gunderson [Wed, 10 Dec 2014 00:23:03 +0000 (01:23 +0100)]
Click on book line headings to sort by that heading.
Steinar H. Gunderson [Wed, 10 Dec 2014 00:17:58 +0000 (01:17 +0100)]
Refactor/unify book line display.
Steinar H. Gunderson [Tue, 9 Dec 2014 23:36:20 +0000 (00:36 +0100)]
Let book headings be dynamic.
Steinar H. Gunderson [Tue, 9 Dec 2014 23:28:54 +0000 (00:28 +0100)]
Add more columns, and hide Elo variables if we have less than 10 samples.
Steinar H. Gunderson [Tue, 9 Dec 2014 21:09:20 +0000 (22:09 +0100)]
Tune compression options a bit for intermediates (binloader) vs. final output (binmerger).
Steinar H. Gunderson [Tue, 9 Dec 2014 19:58:22 +0000 (20:58 +0100)]
Add some utilities to be able to build books in parts, so we do not need as much memory.
Steinar H. Gunderson [Tue, 9 Dec 2014 19:22:33 +0000 (20:22 +0100)]
Store sum and number of Elo values instead of averages, for easier merging.
Steinar H. Gunderson [Tue, 9 Dec 2014 01:17:22 +0000 (02:17 +0100)]
Some path fixes for the standalone lookup.
Steinar H. Gunderson [Tue, 9 Dec 2014 01:03:12 +0000 (02:03 +0100)]
Add a Makefile for the book builder stuff.
Steinar H. Gunderson [Tue, 9 Dec 2014 01:00:36 +0000 (02:00 +0100)]
Reuse the remoteglot library for a new book project.
Remove everything not related to the (new) book building.
It will keep on living in the remoteglot repository.
Steinar H. Gunderson [Tue, 9 Dec 2014 00:43:55 +0000 (01:43 +0100)]
Update the .gitignore field to keep my sanity.
Steinar H. Gunderson [Mon, 8 Dec 2014 23:06:16 +0000 (00:06 +0100)]
Fix misattribution.
Steinar H. Gunderson [Thu, 4 Dec 2014 18:58:19 +0000 (19:58 +0100)]
Support constructing Position objects from FEN strings.
Steinar H. Gunderson [Wed, 3 Dec 2014 23:07:22 +0000 (00:07 +0100)]
We do not need to prettyprint a move if we already have the pretty form.
Steinar H. Gunderson [Wed, 3 Dec 2014 22:58:56 +0000 (23:58 +0100)]
Be lazier when parsing pretty moves. About 25% speedup in PGN parsing.
Steinar H. Gunderson [Wed, 3 Dec 2014 22:49:12 +0000 (23:49 +0100)]
A little serve-analysis bugfix I forgot to commit.
Steinar H. Gunderson [Wed, 3 Dec 2014 22:38:50 +0000 (23:38 +0100)]
Add board/position output to a bitpacked format.
Steinar H. Gunderson [Wed, 3 Dec 2014 17:44:15 +0000 (18:44 +0100)]
Remove en passant hack for Rybka 2, which is now obsolete; we would rather have the canonically correct FEN.
Steinar H. Gunderson [Tue, 25 Nov 2014 17:25:39 +0000 (18:25 +0100)]
More header squeezing.
Steinar H. Gunderson [Tue, 25 Nov 2014 17:22:00 +0000 (18:22 +0100)]
Some pointless HTTP header microoptimization.
Steinar H. Gunderson [Tue, 25 Nov 2014 17:17:09 +0000 (18:17 +0100)]
No longer serve Expires header; it is not needed.
Steinar H. Gunderson [Tue, 25 Nov 2014 17:15:43 +0000 (18:15 +0100)]
Fetch a custom build of jQuery and compile that in; now we actually seem to make some size progress by compilation.
Steinar H. Gunderson [Tue, 25 Nov 2014 16:48:09 +0000 (17:48 +0100)]
Make sure we do not try to process more than one analysis.json update at a time.
Steinar H. Gunderson [Tue, 25 Nov 2014 16:44:42 +0000 (17:44 +0100)]
Make some constants SHOUT_A_BIT.
Steinar H. Gunderson [Tue, 25 Nov 2014 16:43:44 +0000 (17:43 +0100)]
Add support for delta JSON, to squeeze the request size down further.
Steinar H. Gunderson [Tue, 25 Nov 2014 00:08:50 +0000 (01:08 +0100)]
Add a lazy safeguard against the JSON output being updated when there are actually no updates.
Steinar H. Gunderson [Mon, 24 Nov 2014 23:40:58 +0000 (00:40 +0100)]
Stick most of the properties of the served object in serve-analysis into one package.
Steinar H. Gunderson [Mon, 24 Nov 2014 20:24:38 +0000 (21:24 +0100)]
Remove the obsolete text.pl.
Steinar H. Gunderson [Mon, 24 Nov 2014 20:24:29 +0000 (21:24 +0100)]
Add the historic text.pl, so we can delete it right afterwards.
Steinar H. Gunderson [Mon, 24 Nov 2014 20:21:22 +0000 (21:21 +0100)]
Upgrade to jQuery 2.1.1; 10 kB smaller, and we have nearly no IE8 users (or older).
Steinar H. Gunderson [Mon, 24 Nov 2014 20:17:50 +0000 (21:17 +0100)]
Clean up the minification stuff a bit; still not really in use.
Steinar H. Gunderson [Mon, 24 Nov 2014 19:46:08 +0000 (20:46 +0100)]
Remove unused JavaScript.
Steinar H. Gunderson [Mon, 24 Nov 2014 19:41:10 +0000 (20:41 +0100)]
Fix some warnings.
Steinar H. Gunderson [Sun, 23 Nov 2014 13:44:28 +0000 (14:44 +0100)]
Deal with strange PGN download failures.
Steinar H. Gunderson [Sun, 23 Nov 2014 12:02:46 +0000 (13:02 +0100)]
Deal with inconsistent zero padding in PGN clocks.
Steinar H. Gunderson [Sun, 23 Nov 2014 11:23:52 +0000 (12:23 +0100)]
Do not bold anything when there is no running clock.
Steinar H. Gunderson [Sun, 23 Nov 2014 00:52:38 +0000 (01:52 +0100)]
Set the active clock in bold.
Steinar H. Gunderson [Sun, 23 Nov 2014 00:48:04 +0000 (01:48 +0100)]
Do not show seconds in the clocks; a bit too distracting.
Steinar H. Gunderson [Sun, 23 Nov 2014 00:42:13 +0000 (01:42 +0100)]
Add clock support.
Steinar H. Gunderson [Sat, 22 Nov 2014 14:01:24 +0000 (15:01 +0100)]
Add the Varnish configuration we are currently using (stripped of everything irrelevant).
Steinar H. Gunderson [Sat, 22 Nov 2014 11:13:14 +0000 (12:13 +0100)]
Explicitly prefer Opus over MP3.
Steinar H. Gunderson [Sat, 22 Nov 2014 01:53:01 +0000 (02:53 +0100)]
In <title>, there is nothing to align, so remove the funny-looking space.
Steinar H. Gunderson [Sat, 22 Nov 2014 01:43:52 +0000 (02:43 +0100)]
Store sound and sorting settings in HTML5 local storage.
Steinar H. Gunderson [Sat, 22 Nov 2014 01:28:47 +0000 (02:28 +0100)]
Support a ding sound per move. Off by default, of course.
Steinar H. Gunderson [Fri, 21 Nov 2014 23:56:45 +0000 (00:56 +0100)]
Fix the red note on moves where we have no historic analysis.
Steinar H. Gunderson [Fri, 21 Nov 2014 23:35:34 +0000 (00:35 +0100)]
Show correct highlight also for historical moves with no analysis.
Steinar H. Gunderson [Fri, 21 Nov 2014 21:21:51 +0000 (22:21 +0100)]
Add a favicon (it is the white knight from chessboard.js/Wikipedia, scaled down to 32x32).
Steinar H. Gunderson [Fri, 21 Nov 2014 21:21:05 +0000 (22:21 +0100)]
Show highlight and arrows for history moves.
Steinar H. Gunderson [Thu, 20 Nov 2014 23:17:09 +0000 (00:17 +0100)]
Unbreak history storing again.
Steinar H. Gunderson [Thu, 20 Nov 2014 22:42:42 +0000 (23:42 +0100)]
Send the pretty moves instead of the UCI moves; seemingly calculating all the multi-PV ones for display was making the JavaScript really slow.
Steinar H. Gunderson [Thu, 20 Nov 2014 22:15:55 +0000 (23:15 +0100)]
Support displaying historic analysis. Not perfect still, though.
Steinar H. Gunderson [Thu, 20 Nov 2014 21:10:13 +0000 (22:10 +0100)]
Some refactorings out of update_board().
Steinar H. Gunderson [Thu, 20 Nov 2014 20:33:18 +0000 (21:33 +0100)]
Minor pruning of some unused JSON fields.
Steinar H. Gunderson [Thu, 20 Nov 2014 20:02:59 +0000 (21:02 +0100)]
Start using Chess.js.
The main motivation for importing yet another library (thankfully
it's not that big; 17 kB pre-gzip should be livable) is to get
accurate FENs for history support later. However, right now we
grab the following two nice side effects:
- We don't have to maintain our own castling and en passant logic
anymore.
- We don't have to send both UCI and prettyprinted moves over,
reducing the JSON size by something like 40% (I haven't checked
post-gzip, though). Currently we just send the UCI, but maybe
it should be reversed; we need to check if this causes problems
for CPU usage or something during normal updates, and which one
compresses better..
Steinar H. Gunderson [Thu, 20 Nov 2014 19:36:46 +0000 (20:36 +0100)]
Do not hardcode the domain; no longer needed since Varnish directs for us.
Steinar H. Gunderson [Thu, 20 Nov 2014 18:14:10 +0000 (19:14 +0100)]
Put last move in <title>. Idea from Stephan Brumme.
Steinar H. Gunderson [Wed, 19 Nov 2014 22:53:56 +0000 (23:53 +0100)]
Avoid overwriting earlier historical analysis if it is better.
Steinar H. Gunderson [Wed, 19 Nov 2014 22:24:55 +0000 (23:24 +0100)]
Output historic analysis (not used by the frontend yet).
Steinar H. Gunderson [Wed, 19 Nov 2014 22:24:35 +0000 (23:24 +0100)]
Factor out atomic file overwriting into its own function.
Steinar H. Gunderson [Tue, 18 Nov 2014 17:33:40 +0000 (18:33 +0100)]
Do not stop polling PGNs if they are invalid.
Steinar H. Gunderson [Sun, 16 Nov 2014 18:33:28 +0000 (19:33 +0100)]
Fix 7-man tablebase mate length.
Steinar H. Gunderson [Sun, 16 Nov 2014 18:19:48 +0000 (19:19 +0100)]
Make stoppgn more robust.
Steinar H. Gunderson [Sun, 16 Nov 2014 18:19:32 +0000 (19:19 +0100)]
Remove some stray debugging code.
Steinar H. Gunderson [Sun, 16 Nov 2014 13:07:09 +0000 (14:07 +0100)]
Add a little comment about the serial key format.
Steinar H. Gunderson [Sun, 16 Nov 2014 12:55:11 +0000 (13:55 +0100)]
Use AnyEvent instead of signals in varnishcount.pl as well, since it seems signals cause Perl segfaults.
Steinar H. Gunderson [Sun, 16 Nov 2014 12:39:49 +0000 (13:39 +0100)]
Fix a display bug on empty PV.
Steinar H. Gunderson [Sun, 16 Nov 2014 12:35:48 +0000 (13:35 +0100)]
Send the right Vary headers.
Steinar H. Gunderson [Sun, 16 Nov 2014 12:35:07 +0000 (13:35 +0100)]
Add a separate script for counting viewers from Varnish logs.
Steinar H. Gunderson [Sun, 16 Nov 2014 10:46:45 +0000 (11:46 +0100)]
Use an AnyEvent timer instead of an alarm.
Steinar H. Gunderson [Sat, 15 Nov 2014 23:57:56 +0000 (00:57 +0100)]
Solve timeouts by touching analysis.json.
This means we need to carry fewer timeouts around, and also that
caching behavior in Varnish will be easier to control (results
are always cacheable, we don't need special handling for hanging ones).
It means slightly more thundering herd behavior, but we'll have that
anyway.
Steinar H. Gunderson [Sun, 16 Nov 2014 10:35:11 +0000 (11:35 +0100)]
Fix PGN parsing; it was broken by a scoping change.
Steinar H. Gunderson [Sat, 15 Nov 2014 01:57:04 +0000 (02:57 +0100)]
Add support for fetching move history from FICS (entirely from scratch every time, though).
Steinar H. Gunderson [Sat, 15 Nov 2014 01:56:31 +0000 (02:56 +0100)]
Slightly better diagnostics.
Steinar H. Gunderson [Sat, 15 Nov 2014 00:53:22 +0000 (01:53 +0100)]
Do observe after we have set up AnyEvent listening; otherwise, seemingly we can get problems missing the initial line.
Steinar H. Gunderson [Fri, 14 Nov 2014 23:29:30 +0000 (00:29 +0100)]
Add some PGN hysteresis to guard against truncated PGNs.
Steinar H. Gunderson [Fri, 14 Nov 2014 23:03:05 +0000 (00:03 +0100)]
Support defaulting to a PGN for fetching.