Merge Sort: stack-safe, tail-recursive, in pure immutable Scala, N-way
Algorithm goal
Note: the explanation and description are quite long so the format of the page is different from the usual.
Merge Sort is a standard merging algorithm - it works by grouping items into pairs, and then merging those pairs by selecting the smallest items from each pair in order. Then, it repeats this process until 1 whole array is computed.
Our goal is to achieve a sorting like this:
3 | 2 | 1 | 4 |
1 | 2 | 3 | 4 |
Merge sort algorithm illustration
The data transformation in Merge Sort looks like this:
Resulting List | Left Half | Right Half | |||||||
---|---|---|---|---|---|---|---|---|---|
Original list (split in half) | |||||||||
3 | 2 | 4 | 1 | ||||||
Applying a merge+sort function to each of the halves | |||||||||
2 | 3 | 1 | 4 | ||||||
Then, in the merge function, we begin to extract the smallest elements (as the two halves are sorted) | |||||||||
2 | 3 | 1 | 4 | ||||||
1 | 2 | 3 | 4 | ||||||
1 | 2 | 3 | 4 | ||||||
1 | 2 | 3 | 4 | ||||||
1 | 2 | 3 | 4 | ||||||
And now we have solved one level of merging. |
In the non-stack-safe version, we achieve this via recursion, where we really say 'our sorted version is the merge of sorting of the two halves of our original input'.
This version is stack-safe (and thus a bit more complicated); to find the standard recursive version, see here: MergeSort.
Explanation
This solution takes a bottom-up approach to avoid having to use non-tail recursion (which is not stack-safe).
We group all input items into pairs of 2, and then repeat as per the problem definition. (this is © from www.scala-algorithms.com)
The difference to many other solutions out there is that we do not split the input, but rather read from it sequentially, meaning that it is quite intuitive. Another beneficial aspect is that the complexity of the computation is very easy to establish, as the number of iterations required is defined, \(O(n * \log{n})\).
We use a utility method 'iterate' to iterate a function on an initial value n times. LazyList provides us with the 'last' method which allows us to get the iteration really quickly, although we could just as easily use tail recursion to implement it well -- which is a little more verbose.
The merge function
The rest of the Explanation is available for subscribers.
or
'Unlimited Scala Algorithms' gives you access to all the Scala Algorithms!
Upon purchase, you will be able to Register an account to access all the algorithms on multiple devices.
Algorithm in Scala
29 lines of Scala (version 2.13), showing how concise Scala can be!
This solution is available for access!
or
'Unlimited Scala Algorithms' gives you access to all the Scala Algorithms!
Upon purchase, you will be able to Register an account to access all the algorithms on multiple devices.
Test cases in Scala
assert(mergeSort(Vector.empty) == Vector.empty)
assert(mergeSort(Vector(1)) == Vector(1))
assert(mergeSort(Vector(1, 2)) == Vector(1, 2))
assert(mergeSort(Vector(2, 1)) == Vector(1, 2))
assert(mergeSort(Vector(2, 1, 3)) == Vector(1, 2, 3))
assert(mergeSort(Vector(2, 1, 4, 3)) == Vector(1, 2, 3, 4))
assert(mergeSort(Vector(2, 4, 5, 1, 3)) == Vector(1, 2, 3, 4, 5))
assert(
{
val randomArray = scala.util.Random
.nextBytes(10 + Math.abs(scala.util.Random.nextInt(1000)))
.map(_.toInt)
.toVector
mergeSort(randomArray) == randomArray.sorted
},
"Random array of any length is sorted"
)
Scala Concepts & Hints
- Def Inside Def
A great aspect of Scala is being able to declare functions inside functions, making it possible to reduce repetition.
def exampleDef(input: String): String = { def surroundInputWith(char: Char): String = s"$char$input$char" surroundInputWith('-') }
It is also frequently used in combination with Tail Recursion.
- Drop, Take, dropRight, takeRight
Scala's `drop` and `take` methods typically remove or select `n` items from a collection.
assert(List(1, 2, 3).drop(2) == List(3)) assert(List(1, 2, 3).take(2) == List(1, 2)) assert(List(1, 2, 3).dropRight(2) == List(1)) assert(List(1, 2, 3).takeRight(2) == List(2, 3)) assert((1 to 5).take(2) == (1 to 2))
- Lazy List
The 'LazyList' type (previously known as 'Stream' in Scala) is used to describe a potentially infinite list that evaluates only when necessary ('lazily').
- Ordering
In Scala, the 'Ordering' type is a 'type class' that contains methods to determine an ordering of specific types.
assert(List(3, 2, 1).sorted == List(1, 2, 3)) assert(List(3, 2, 1).sorted(Ordering[Int].reverse) == List(3, 2, 1)) assert(Ordering[Int].lt(1, 2)) assert(!Ordering[Int].lt(2, 1))
- Pattern Matching
Pattern matching in Scala lets you quickly identify what you are looking for in a data, and also extract it.
assert("Hello World".collect { case character if Character.isUpperCase(character) => character.toLower } == "hw")
- Stack Safety
Stack safety is present where a function cannot crash due to overflowing the limit of number of recursive calls.
This function will work for n = 5, but will not work for n = 2000 (crash with java.lang.StackOverflowError) - however there is a way to fix it :-)
In Scala Algorithms, we try to write the algorithms in a stack-safe way, where possible, so that when you use the algorithms, they will not crash on large inputs. However, stack-safe implementations are often more complex, and in some cases, overly complex, for the task at hand.
def sum(from: Int, until: Int): Int = if (from == until) until else from + sum(from + 1, until) def thisWillSucceed: Int = sum(1, 5) def thisWillFail: Int = sum(1, 300)
- Tail Recursion
In Scala, tail recursion enables you to rewrite a mutable structure such as a while-loop, into an immutable algorithm.
def fibonacci(n: Int): Int = { @scala.annotation.tailrec def go(i: Int, previous: Int, beforePrevious: Int): Int = if (i >= n) previous else go(i + 1, previous + beforePrevious, previous) go(i = 1, previous = 1, beforePrevious = 0) } assert(fibonacci(8) == 21)
def mergeSort(input: Vector[Int]): Vector[Int] = ???