Development Version
News and Updates on X
SudokuWiki.org
Strategies for Popular Number Puzzles

The Relative Incidence of Sudoku Strategies

This article has been updated May 2024 and replaces the statistics done in Dec 2009 and March 2012 and 2013 (you can compare the previous data on that page).

A recent question from a reader prompted me to run off some statistics which I think are interesting and worth exploring.

Comment:There is something I am curious about that I really hope you can answer, although it's quite subjective and I suppose the answer will be a ballpark figure but I was hoping a Sudoku expert such as yourself could take your best educated guess at.

If I know all of your basic, tough, and diabolical strategies, but don't go as far as any of your evil strategies that you list, what percentage of Sudoku puzzles (in your opinion) do you think I could solve-80% of all puzzles that I would try? 85%? 90%? 95%? 99%?

What would you guess if you had to estimate? I know it's hard since there are literally trillions of puzzles, but easy, medium, tough, and many diabolical puzzles I can already solve with these current strategies, excluding your evil ones. Do you think the percentage of puzzles where you HAVE to use one or more evil strategies in order to solve the puzzle is a small percentage, perhaps 1%? 2%? 5%? 10%?

Just curious what your opinion is.

There is a lot to grading and scoring a Sudoku puzzle. I've put some thoughts about this into
https://www.sudokuwiki.org/Sudoku_Creation_and_Grading.pdf. There is not a one to one correspondence between the published grade (or the grade on my solver) and the list of strategies and many factors contribute to the grade. My strategy list is partially subjective in that I choose to label certain strategies as 'tough' for ease of explanation and to show what I consider the best order in which to attack a puzzle. It is an attempt at a 'minimum path'.

It should also be noted that because I don't use strategy X to solve a puzzle in the solver, it does not follow that strategy X could not be used. There are often many ways to solve the same puzzle.

However it is still an interesting question what proportion of all puzzles require at least one strategy in each grade group. I've run a count on a 141,672 puzzles I created in May 2024. These were produced randomly and I did not know the grade until after I created them. The sample is therefore fair. The results are:

  • 48.4% required only trivial strategies, that is only naked and hidden singles.
  • 17.6% required the use of Naked Pairs and Hidden Pairs.
  • 6.5% required the above and diabolical strategies
  • 4.0% required the above and extreme strategies
  • In addition to 141,672 solvable puzzles made, 4 could not be solved using my list of logical strategies

This confirms my view that the vast majority of puzzles are uninteresting. In order to produce a 100 puzzles of all grades I need to over produce many puzzles since the incidence of higher grade puzzles is low. Note that the 10% of 'moderate' only puzzles does not mean they are rare. Any hard puzzle will require many more incidences of moderate strategies to complete in addition to the hard ones.

It follows that I can produce a list of all the Sudoku strategies and a count of their occurrences in solving the stock. Where different types or rules are available I've also added those as seperate figures.
*
Note: The first column is how many puzzles where the strategy is used. The second is how many instances were found overall.
The % is the number of times that strategy is used compared to the sum of all strategies.
The % inside specific strategies (eg UR) is the % within that strategy and should add up to 100%
Naked Singles141672258586674.48%
Hidden Singles13642249577414.28%
Naked Pair4495971858 2.07%
Naked Triple2354229360 0.85%
Hidden Pair919410179 0.29%
Hidden Triple18821932 0.06%
Naked Quad255258 0.01%
Hidden Quad1313 0.00%
Tough Strategies
Pointing Pairs3256377272 2.23%
Line/Box Reduction1592821826 0.63%
Gurths Theorem00 0.00%
X-Wing76868594 0.25%
Simple Colouring1774724202 0.70%
Rule 26113 25.26%
Rule 418089 74.74%
Y-Wing1468318510 0.53%
Rectangle Elimination1174716683 0.48%
Sword-Fish846860 0.02%
XYZ Wing54056065 0.17%
Almost Locked Pair00 0.00%
Bi-value Universal Grave10691069 0.03%
X-Cycle46055630 0.16%
Strong Links876 15.56%
Weak Links4545 80.73%
Off-chain209  3.71%
XY-Chain1665836159 1.04%
Diabolical Strategies
3D Medusa57188012 0.23%
Rule 1473  5.90%
Rule 2226  2.82%
Rule 3689  8.60%
Rule 42100 26.21%
Rule 64200 52.42%
Rule 7324  4.04%
Jelly-Fish1010 0.00%
Unique Rectangle21352285 0.07%
Type 1 740 32.39%
Type 2 158  6.91%
Type 2b46  2.01%
Type 2c11  0.48%
Type 3 39  1.71%
Type 3b218  9.54%
Type 4 661 28.93%
Type 4b236 10.33%
Type 5 176  7.70%
Avoidable Rectangle2525 0.00%
Fireworks111112 0.00%
Extreme Strategies
SK Loops00 0.00%
Extended Unique Rectangle101102 0.00%
Type 172 70.59%
Type 2 0.00%
Type 430 29.41%
Hidden Unique Rectangle49116282 0.18%
Type 13468 55.21%
Type 21676 26.68%
Type 2b1138 18.12%
WXYZ Wing33474116 0.12%
Aligned Pair Exclusion37815379 0.15%
Extreme Strategies
Exocet22 0.00%
Rule 1 60.00%
Rule 5 40.00%
Grouped X-Cycle25293756 0.11%
Strong Links116  3.09%
Weak Links3498 93.13%
Off-chain142  3.78%
Finned X-Wing00 0.00%
Finned Sword-Fish387396 0.01%
Franken Sword-Fish00 0.00%
Alternating Infer. Chains799524212 0.70%
Strong Links9351 38.62%
Weak Links12631 52.17%
Off-chain2230  9.21%
Sue-de-Coq1717 0.00%
Digit Forcing Chain8901899 0.05%
Nishio Forcing Chain3947 0.00%
Cell Forcing Chain8302274 0.07%
Unit Forcing Chain208553 0.02%
Almost Locked Sets1014 0.00%
Death Blossom20 0.00%
Pattern Overlay1718 0.00%
Quad Forcing Chain5177 0.00%
Bowman Bingo53172 0.00%

So if you were wondering, as I was, how useful certain strategies are, this data is interesting. The only other caveat I'd add is that some strategies are sub-sets of others, or can be expressed in terms of another strategy. For example, Remote Pairs are a special case of XY-Chains which is a sub-set of AICs. It is useful for the solver to split these out but when making and grading I don't do so. So there is some overlap.

The answer to the reader's original question - the incidence of 'evil' strategies, is I'd say, about 5%.

Andrew Stuart

Go back to Arto InkalaContinue to 17 Clue Proof


Comments

CommentsTalk

... by: Manohar Kulkarni

Tuesday 20-Aug-2024
The side menu in, lists four grades, namely, (i) Basic, (ii) Tough, (iii) Diabolical, and (iv) Extreme.
Two questions:
(1) The post dies not contain data on the % of tough puzzles. Can you please furnish?
(2) Which are the, "Evil" strategies? Are they included in the grade, "Extreme"/
Andrew Stuart writes:
It's complicated. But I do into much more depth in this document: Sudoku Creation and Grading.
Add to this Thread

... by: poppinfresh

Sunday 12-May-2024
The MAIN percents (on rightmost column) don't add to 100%, so I assume that when there is overlap (for example, a swordfish often comes with an X-cycle) they are ALL counted.

Since I highly doubt that all possible solutions paths are followed for a single puzzle, I then guess what happens is that, the topmost (easiest) strategy is CHOSEN to be performed to get to the next step of puzzle, though ALL possible moves for that step are counted??? Not sure if the unused strategies get recounted (for calculating the percentages) if the move is still available on the next step?

Perhaps there is simply just a bug in the code that calculated the percentages. Either way, I am extremely curious how to interpret these numbers!
Andrew Stuart writes:
Possible the % meaning is lost in the text above which hints at this: "the proportion of all puzzles require at least one strategy..." - so the % refers to the number of puzzles out of the 120,000 which require that strategy to get solved. This is assuming the actual path is optimal (it probably isn't since my ordering is partly subjective - on considering what is more and less complicated) and it's true I don't try all possible strategies in each round. So l use the word 'required' to mean 'no simpler strategy worked'. I have my doubts about the first one, Naked Single. Ought to be very close to 100% so I'll run this report again. Needs a refresh anyway since so much has changed in a decade.
Add to this Thread

... by: Uhm

Saturday 3-Sep-2016
About Finned X-Wing 0 0.00%

What does this tell, can you run the test and place Finned X-wing before Grouped X-Cycle.

Finned X-wing is a full subset of Grouped X-Cycle
When fin size=1 its a full subset of X-Cycles

Why is there no detail about normal X-Cycles, like "Strong Links, Weak Links, Off-chain " like you did with some other strategies.

About 3d Medusa, there are now only 6 rules instead of 7
REPLY TO THIS POST

... by: Fred

Monday 24-Dec-2012
Very, very interesting ! You have all my compliments and my deepest admiration. Unfortunately I am not of english mother tongue, so for me difficulties always grow harder and harder.
Do you think I can find anything on this subject printed in ITALIAN ? eventually, where ?

Thanks for the attention,

Emmanuele Frediani (from Italy)


P. S. : Just a curiosity : How old are you ?
REPLY TO THIS POST

... by: slowofmind

Friday 29-Jun-2012
Smashblast, could you please say what year is the Scientific American article "The Science behind Sudoku".
Andrew Stuart writes:
2006 I think
Add to this Thread

... by: PeteTy

Monday 7-May-2012
everything in the grading and strategy seems to be
only relevant to the garden variety sudokus

with jigsaws after pairs and singles
LOL will solve puzzles that most of the chains and advanced stuff cant touch

with killers its a whole new ball game arithmetic gets things that none of the other strategies cant begin to see

things the solver doesnt check for that are very common in killers
example column 1+2+3+4 outie
these seem to jump out at me when i look at a puzzle

sometimes there are triple outies of 6 or 24 that arent apparent to me before the arithmetic but surely help in solving and they give a naked triple that the solvers dont see.

these are simple strategies for killers but beyond diabolical for the garden variety.
REPLY TO THIS POST

... by: keith

Tuesday 1-May-2012
Hmmm. It would be interesting, perhaps, to mix up the order of your solving strategies, and try a series of them, looking for 1) how they change the incidence of use, and 2) whether/how some orders reduce the length of puzzle solving. In the second instance, one can imagine that puzzles "requiring" a diabolical strategy, for example, might benefit from it being applied earlier... or not.

There are a great many orderings you could try, I'm not sure which would be most interesting/powerful, if indeed any succeed over the default...
Andrew Stuart writes:
This I have pondered for a long time and I do try out some reorderings because there is a lot of overlap between certain strategies. Sometimes I can eliminate a strategy altogether by parking it at the end of the list but some are subsets which are easier to identify so I have to put them before the more generic strategy. If I had some time, like some weeks, I'd write a program to test all the combinations and see if there was an optimal arrangement - ie one that reduced the score. The problem with that approach is it might produce a low score for many puzzles but that score depends entirely on following a particular route - which may be esoteric - and therefore the low score is misleading.

The ordering I have settled on is subjective in a certain sense because I've decided on it based on my hunch that strategy A is more complex that strategy B. The early strategies I think are no brainers but diabolical and above are more difficult to order.

I would like to allow the user to order the strategies but I don't know how to do this without greatly complicating the interface - another trade off
Add to this Thread

... by: Smashblast

Wednesday 8-Feb-2012
There was an eneeellcxt article on the "science behind Sudoku" in July issue of Scientific American, with more strategies, worth reading.
REPLY TO THIS POST

... by: joseph brophy

Monday 20-Sep-2010
thank you so much for your contributions to sudoku. i am preparing to teach a class to seniors, and this is the type of information that sheds light on the game. jtb
REPLY TO THIS POST
Article created on 31-December-2009. Views: 52790
This page was last modified on 17-May-2024.
All text is copyright and for personal use only but may be reproduced with the permission of the author.
Copyright Andrew Stuart @ Syndicated Puzzles, Privacy, 2007-2024