Bump version to 0.15.5

AutoIdentifierOptions clarification

changelog.md

@@ -1,140 +1,149 @@
-# Changelog
-
-## 0.15.3 (15 Sep 2018)
-- Add support for RTL ([(PR #239)](https://github.com/lunet-io/markdig/pull/239))
-- Add MarkdownDocument.LineCount ([(PR #241)](https://github.com/lunet-io/markdig/pull/241))
+# Changelog
+
+## 0.15.5 (11 Dec 2018)
+- Empty image alt text for link reference definitions ([(PR #254)](https://github.com/lunet-io/markdig/pull/254))
+- Fix AutoLink Match links without slash after domain ([(PR #260)](https://github.com/lunet-io/markdig/pull/260))
+- Make AutoLink ValidPreviousCharacters configurable ([(PR #264)](https://github.com/lunet-io/markdig/pull/264))
+- Ensuring line breaks when renderer does not have html enabled ([(PR #270)](https://github.com/lunet-io/markdig/pull/270))
+
+## 0.15.4 (07 Oct 2018)
+- Add autolink domain GFM validation ([(PR #239)](https://github.com/lunet-io/markdig/pull/253))
+
+## 0.15.3 (15 Sep 2018)
+- Add support for RTL ([(PR #239)](https://github.com/lunet-io/markdig/pull/239))
+- Add MarkdownDocument.LineCount ([(PR #241)](https://github.com/lunet-io/markdig/pull/241))
 - Fix source positions for link definitions ([(PR #243)](https://github.com/lunet-io/markdig/pull/243))
 - Add ListItemBlock.Order ([(PR #244)](https://github.com/lunet-io/markdig/pull/244))
-- Add MarkdownDocument.LineStartIndexes ([(PR #247)](https://github.com/lunet-io/markdig/pull/247))
-
-## 0.15.2 (21 Aug 2018)
-- Fix footnotes parsing when they are defined after a container that has been closed in the meantime (#223)
-
-## 0.15.1 (10 July 2018)
-- Add support for `netstandard2.0`
-- Make AutoIdentifierExtension thread safe
-
-## 0.15.0 (4 Apr 2018)
-- Add `ConfigureNewLine` extension method to `MarkdownPipelineBuilder` ([(PR #214)](https://github.com/lunet-io/markdig/pull/214))
-- Add alternative `Use` extension method to `MarkdownPipelineBuilder` that receives an object instance ([(PR #213)](https://github.com/lunet-io/markdig/pull/213))
-- Added class attribute to media link extension ([(PR #203)](https://github.com/lunet-io/markdig/pull/203))
-- Optional link rewriter func for HtmlRenderer #143 ([(PR #201)](https://github.com/lunet-io/markdig/pull/201))
-- Upgrade NUnit3TestAdapter from 3.2 to 3.9 to address Resharper test runner problems ([(PR #199)](https://github.com/lunet-io/markdig/pull/199))
-- HTML renderer supports converting relative URLs on links and images to absolute #143 ([(PR #197)](https://github.com/lunet-io/markdig/pull/197))
-
-## 0.14.9 (15 Jan 2018)
-- AutoLinkParser should to remove mailto: in outputted text ([(PR #195)](https://github.com/lunet-io/markdig/pull/195))
-- Add support for `music.yandex.ru` and `ok.ru` for MediaLinks extension ([(PR #193)](https://github.com/lunet-io/markdig/pull/193))
-## 0.14.8 (05 Dec 2017)
-- Fix potential StackOverflow exception when processing deep nested `|` delimiters (#179)
-## 0.14.7 (25 Nov 2017)
-- Fix autolink attached attributes not being displayed properly (#175)
-## 0.14.6 (21 Nov 2017)
-- Fix yaml frontmatter issue when ending with a empty line (#170)
-## 0.14.5 (18 Nov 2017)
-- Fix changelog link from nuget package
-## 0.14.4 (18 Nov 2017)
-- Add changelog.md
-- Fix bug when a thematic break is inside a fenced code block inside a pending list (#164)
-- Add support for GFM autolinks (#165, #169)
-- Better handle YAML frontmatter in case the opening `---` is never actually closed (#160)
-- Fix link conflict between a link to an image definition and heading auto-identifiers (#159)
-## 0.14.3
-- Make EmojiExtension.EnableSmiley public
-## 0.14.2
-- Fix issue with emphasis preceded/followed by an HTML entity (#157)
-- Add support for link reference definitions for Normalize renderer (#155)   
-- Add option to disable smiley parsing in EmojiAndSmiley extension
-## 0.14.1
-- Fix crash in Markdown.Normalize to handle HtmlBlock correctly        
-- Add better handling of bullet character for lists in Markdown.Normalize
-## 0.14.0
-- Add Markdown.ToPlainText, Add option HtmlRenderer.EnableHtmlForBlock.
-- Add Markdown.Normalize, to allow to normalize a markdown document. Add NormalizeRenderer, to render a MarkdownDocument back to markdown.
-## 0.13.4
-- Add support for single table header row without a table body rows (#141)
-- ADd support for `nomnoml` diagrams
-## 0.13.3
-- Add support for Pandoc YAML frontmatter (#138)
-## 0.13.2
-- Add support for UAP10.0 (#137)
-## 0.13.1
-- Fix indenting issue after a double digit list block using a tab (#134)
-## 0.13.0
-- Update to latest CommonMark specs 0.28
-## 0.12.3
- - Fix issue with HTML blocks for heading h2,h3,h4,h5,h6 that were not correctly identified as HTML blocks as per CommonMark spec
-## 0.12.2
- - Fix issue with generic attributes used just before a pipe table (issue #121)
-## 0.12.1
- - Fix issue with media links extension when a URL to video is used, an unexpected closing `</iframe>` was inserted (issue #119)
-## 0.12.0
- - Add new extension JiraLink support (thanks to @clarkd)
- - Fix issue in html attributes not parsing correctly properties (thanks to @meziantou)
- - Fix issues detected by an automatic static code analysis tool
-## 0.11.0
- - Fix issue with math extension and $$ block parsing not handling correctly beginning of a $$ as a inline math instead (issue #107)
- - Fix issue with custom attributes for emphasis
- - Add support for new special custom arrows emoji (`->` `<-` `<->` `<=` `=>` `<==>`)
-## 0.10.7
- - Fix issue when an url ends by a dot `.`
-## 0.10.6
- - Fix emphasis with HTML entities
-## 0.10.5
- - Several minor fixes
-## 0.10.4
- - Fix issue with autolinks
- - Normalize number of columns for tables
-## 0.10.3
- - Fix issue with pipetables shifting a cell to a new column (issue #73)
-## 0.10.2
- - Fix exception when trying to urlize an url with an unicode character outside the supported range by NormD (issue #75)
-## 0.10.1
-- Update to latest CommonMark specs
-- Fix source span for LinkReferenceDefinition
-## 0.10.0
-- Breaking change of the IMarkdownExtension to allow to receive the MarkdownPipeline for the renderers setup
-## 0.9.1
-- Fix regression bug with conflicts between autolink extension and html inline/regular links
-## 0.9.0
-- Add new Autolink extension
-## 0.8.5
-- Allow to force table column alignment to left
-## 0.8.4
-- Fix issue when calculating the span of an indented code block within a list. Make sure to include first whitespace on the line
-## 0.8.3
-- fix NullReferenceException with Gridtables extension when a single `+` is entered on a line
-## 0.8.2
-- fix potential cast exception with Abreviation extension and empty literals
-## 0.8.1
-- new extension to disable URI escaping for non-US-ASCII characters to workaround a bug in Edge/IE
-- Fix an issue with abbreviations with left/right multiple non-punctuation/space characters
-## 0.8.0
-- Update to latest CommonMark specs
-- Fix empty literal
-- Add YAML frontmatter extension
-## 0.7.5
-- several bug fixes (pipe tables, disable HTML, special attributes, inline maths, abbreviations...)
-- add support for rowspan in grid tables
-## 0.7.4
-- Fix bug with strong emphasis starting at the beginning of a line
-## 0.7.3
-- Fix threading issue with pipeline
-## 0.7.2
-- Fix rendering of table colspan with non english locale
-- Fix grid table colspan parsing
-- Add nofollow extension for links
-## 0.7.1
-- Fix issue in smarty pants which could lead to an InvalidCastException
-- Update parsers to latest CommonMark specs
-## 0.7.0
-- Update to latest NETStandard.Library 1.6.0
-- Fix issue with digits in auto-identifier extension
-- Fix incorrect start of span calculated for code indented blocks
-## 0.6.2
-- Handle latest CommonMark specs for corner cases for emphasis (See https://talk.commonmark.org/t/emphasis-strong-emphasis-corner-cases/2123/1 )
-## 0.6.1:
-- Fix issue with autoidentifier extension overriding manual HTML attributes id on headings
-## 0.6.0
-- Fix conflicts between PipeTables and SmartyPants extensions
-- Add SelfPipeline extension
+- Add MarkdownDocument.LineStartIndexes ([(PR #247)](https://github.com/lunet-io/markdig/pull/247))
+
+## 0.15.2 (21 Aug 2018)
+- Fix footnotes parsing when they are defined after a container that has been closed in the meantime (#223)
+
+## 0.15.1 (10 July 2018)
+- Add support for `netstandard2.0`
+- Make AutoIdentifierExtension thread safe
+
+## 0.15.0 (4 Apr 2018)
+- Add `ConfigureNewLine` extension method to `MarkdownPipelineBuilder` ([(PR #214)](https://github.com/lunet-io/markdig/pull/214))
+- Add alternative `Use` extension method to `MarkdownPipelineBuilder` that receives an object instance ([(PR #213)](https://github.com/lunet-io/markdig/pull/213))
+- Added class attribute to media link extension ([(PR #203)](https://github.com/lunet-io/markdig/pull/203))
+- Optional link rewriter func for HtmlRenderer #143 ([(PR #201)](https://github.com/lunet-io/markdig/pull/201))
+- Upgrade NUnit3TestAdapter from 3.2 to 3.9 to address Resharper test runner problems ([(PR #199)](https://github.com/lunet-io/markdig/pull/199))
+- HTML renderer supports converting relative URLs on links and images to absolute #143 ([(PR #197)](https://github.com/lunet-io/markdig/pull/197))
+
+## 0.14.9 (15 Jan 2018)
+- AutoLinkParser should to remove mailto: in outputted text ([(PR #195)](https://github.com/lunet-io/markdig/pull/195))
+- Add support for `music.yandex.ru` and `ok.ru` for MediaLinks extension ([(PR #193)](https://github.com/lunet-io/markdig/pull/193))
+## 0.14.8 (05 Dec 2017)
+- Fix potential StackOverflow exception when processing deep nested `|` delimiters (#179)
+## 0.14.7 (25 Nov 2017)
+- Fix autolink attached attributes not being displayed properly (#175)
+## 0.14.6 (21 Nov 2017)
+- Fix yaml frontmatter issue when ending with a empty line (#170)
+## 0.14.5 (18 Nov 2017)
+- Fix changelog link from nuget package
+## 0.14.4 (18 Nov 2017)
+- Add changelog.md
+- Fix bug when a thematic break is inside a fenced code block inside a pending list (#164)
+- Add support for GFM autolinks (#165, #169)
+- Better handle YAML frontmatter in case the opening `---` is never actually closed (#160)
+- Fix link conflict between a link to an image definition and heading auto-identifiers (#159)
+## 0.14.3
+- Make EmojiExtension.EnableSmiley public
+## 0.14.2
+- Fix issue with emphasis preceded/followed by an HTML entity (#157)
+- Add support for link reference definitions for Normalize renderer (#155)   
+- Add option to disable smiley parsing in EmojiAndSmiley extension
+## 0.14.1
+- Fix crash in Markdown.Normalize to handle HtmlBlock correctly        
+- Add better handling of bullet character for lists in Markdown.Normalize
+## 0.14.0
+- Add Markdown.ToPlainText, Add option HtmlRenderer.EnableHtmlForBlock.
+- Add Markdown.Normalize, to allow to normalize a markdown document. Add NormalizeRenderer, to render a MarkdownDocument back to markdown.
+## 0.13.4
+- Add support for single table header row without a table body rows (#141)
+- ADd support for `nomnoml` diagrams
+## 0.13.3
+- Add support for Pandoc YAML frontmatter (#138)
+## 0.13.2
+- Add support for UAP10.0 (#137)
+## 0.13.1
+- Fix indenting issue after a double digit list block using a tab (#134)
+## 0.13.0
+- Update to latest CommonMark specs 0.28
+## 0.12.3
+ - Fix issue with HTML blocks for heading h2,h3,h4,h5,h6 that were not correctly identified as HTML blocks as per CommonMark spec
+## 0.12.2
+ - Fix issue with generic attributes used just before a pipe table (issue #121)
+## 0.12.1
+ - Fix issue with media links extension when a URL to video is used, an unexpected closing `&lt;/iframe&gt;` was inserted (issue #119)
+## 0.12.0
+ - Add new extension JiraLink support (thanks to @clarkd)
+ - Fix issue in html attributes not parsing correctly properties (thanks to @meziantou)
+ - Fix issues detected by an automatic static code analysis tool
+## 0.11.0
+ - Fix issue with math extension and $$ block parsing not handling correctly beginning of a $$ as a inline math instead (issue #107)
+ - Fix issue with custom attributes for emphasis
+ - Add support for new special custom arrows emoji (`->` `<-` `<->` `<=` `=>` `<==>`)
+## 0.10.7
+ - Fix issue when an url ends by a dot `.`
+## 0.10.6
+ - Fix emphasis with HTML entities
+## 0.10.5
+ - Several minor fixes
+## 0.10.4
+ - Fix issue with autolinks
+ - Normalize number of columns for tables
+## 0.10.3
+ - Fix issue with pipetables shifting a cell to a new column (issue #73)
+## 0.10.2
+ - Fix exception when trying to urlize an url with an unicode character outside the supported range by NormD (issue #75)
+## 0.10.1
+- Update to latest CommonMark specs
+- Fix source span for LinkReferenceDefinition
+## 0.10.0
+- Breaking change of the IMarkdownExtension to allow to receive the MarkdownPipeline for the renderers setup
+## 0.9.1
+- Fix regression bug with conflicts between autolink extension and html inline/regular links
+## 0.9.0
+- Add new Autolink extension
+## 0.8.5
+- Allow to force table column alignment to left
+## 0.8.4
+- Fix issue when calculating the span of an indented code block within a list. Make sure to include first whitespace on the line
+## 0.8.3
+- fix NullReferenceException with Gridtables extension when a single `+` is entered on a line
+## 0.8.2
+- fix potential cast exception with Abreviation extension and empty literals
+## 0.8.1
+- new extension to disable URI escaping for non-US-ASCII characters to workaround a bug in Edge/IE
+- Fix an issue with abbreviations with left/right multiple non-punctuation/space characters
+## 0.8.0
+- Update to latest CommonMark specs
+- Fix empty literal
+- Add YAML frontmatter extension
+## 0.7.5
+- several bug fixes (pipe tables, disable HTML, special attributes, inline maths, abbreviations...)
+- add support for rowspan in grid tables
+## 0.7.4
+- Fix bug with strong emphasis starting at the beginning of a line
+## 0.7.3
+- Fix threading issue with pipeline
+## 0.7.2
+- Fix rendering of table colspan with non english locale
+- Fix grid table colspan parsing
+- Add nofollow extension for links
+## 0.7.1
+- Fix issue in smarty pants which could lead to an InvalidCastException
+- Update parsers to latest CommonMark specs
+## 0.7.0
+- Update to latest NETStandard.Library 1.6.0
+- Fix issue with digits in auto-identifier extension
+- Fix incorrect start of span calculated for code indented blocks
+## 0.6.2
+- Handle latest CommonMark specs for corner cases for emphasis (See https://talk.commonmark.org/t/emphasis-strong-emphasis-corner-cases/2123/1 )
+## 0.6.1:
+- Fix issue with autoidentifier extension overriding manual HTML attributes id on headings
+## 0.6.0
+- Fix conflicts between PipeTables and SmartyPants extensions
+- Add SelfPipeline extension

src/Markdig.Tests/Specs/AutoLinks.md

@@ -77,6 +77,14 @@ Check **http://www.a.com** or __http://www.b.com__
 <p>Check <strong><a href="http://www.a.com">http://www.a.com</a></strong> or <strong><a href="http://www.b.com">http://www.b.com</a></strong></p>
 ````````````````````````````````
 
+It is not mentioned by the spec, but empty emails won't be matched (only a subset of [RFC2368](https://tools.ietf.org/html/rfc2368) is supported by auto links):
+
+```````````````````````````````` example
+mailto:email@test.com is okay, but mailto:@test.com is not
+.
+<p><a href="mailto:email@test.com">email@test.com</a> is okay, but mailto:@test.com is not</p>
+````````````````````````````````
+
 ### GFM Support
 
 Extract from [GFM Autolinks extensions specs](https://github.github.com/gfm/#autolinks-extension-)
@@ -140,3 +148,95 @@ Anonymous FTP is available at ftp://foo.bar.baz.
 <p>(Visit <a href="https://encrypted.google.com/search?q=Markup+(business)">https://encrypted.google.com/search?q=Markup+(business)</a>)</p>
 <p>Anonymous FTP is available at <a href="ftp://foo.bar.baz">ftp://foo.bar.baz</a>.</p>
 ````````````````````````````````
+
+### Valid Domain Tests
+
+Domain names that have empty segments won't be matched
+
+```````````````````````````````` example
+www..
+www..com
+http://test.
+http://.test
+http://.
+http://..
+ftp://test.
+ftp://.test
+mailto:email@test.
+mailto:email@.test
+.
+<p>www..
+www..com
+http://test.
+http://.test
+http://.
+http://..
+ftp://test.
+ftp://.test
+mailto:email@test.
+mailto:email@.test</p>
+````````````````````````````````
+
+Domain names with too few segments won't be matched
+
+```````````````````````````````` example
+www
+www.com
+http://test
+ftp://test
+mailto:email@test
+.
+<p>www
+www.com
+http://test
+ftp://test
+mailto:email@test</p>
+````````````````````````````````
+
+Domain names that contain an underscores in the last two segments won't be matched
+
+```````````````````````````````` example
+www._test.foo.bar is okay, but www._test.foo is not
+
+http://te_st.foo.bar is okay, as is http://test.foo_.bar.foo
+
+But http://te_st.foo, http://test.foo_.bar and http://test._foo are not
+
+ftp://test_.foo.bar is okay, but ftp://test.fo_o is not
+
+mailto:email@_test.foo.bar is okay, but mailto:email@_test.foo is not
+.
+<p><a href="http://www._test.foo.bar">www._test.foo.bar</a> is okay, but www._test.foo is not</p>
+<p><a href="http://te_st.foo.bar">http://te_st.foo.bar</a> is okay, as is <a href="http://test.foo_.bar.foo">http://test.foo_.bar.foo</a></p>
+<p>But http://te_st.foo, http://test.foo_.bar and http://test._foo are not</p>
+<p><a href="ftp://test_.foo.bar">ftp://test_.foo.bar</a> is okay, but ftp://test.fo_o is not</p>
+<p><a href="mailto:email@_test.foo.bar">email@_test.foo.bar</a> is okay, but mailto:email@_test.foo is not</p>
+````````````````````````````````
+
+Domain names that contain invalid characters (not AlphaNumberic, -, _ or .) won't be matched
+
+```````````````````````````````` example
+https://[your-domain]/api
+.
+<p>https://[your-domain]/api</p>
+````````````````````````````````
+
+Domain names followed by ?, : or # instead of / are matched
+
+```````````````````````````````` example
+https://github.com?
+
+https://github.com?a
+
+https://github.com#a
+
+https://github.com:
+
+https://github.com:443
+.
+<p><a href="https://github.com">https://github.com</a>?</p>
+<p><a href="https://github.com?a">https://github.com?a</a></p>
+<p><a href="https://github.com#a">https://github.com#a</a></p>
+<p><a href="https://github.com">https://github.com</a>:</p>
+<p><a href="https://github.com:443">https://github.com:443</a></p>
+````````````````````````````````

src/Markdig.Tests/Specs/FootnotesSpecs.md

@@ -2,7 +2,7 @@
 
 This section describes the different extensions supported:
 
-## Footontes
+## Footnotes
 
 Allows footnotes using the following syntax (taken from pandoc example):
 

src/Markdig.Tests/Specs/Specs.tt

@@ -1,6 +1,6 @@
 <#/*
 Copyright (c) Alexandre Mutel. All rights reserved.
-This file is licensed under the BSD-Clause 2 license. 
+This file is licensed under the BSD-Clause 2 license.
 See the license.txt file in the project root for more information.The MIT License (MIT)
 
 This is a modified version of code released previously with the following license:

src/Markdig.Tests/Specs/YamlSpecs.md

@@ -80,7 +80,7 @@ This is a text
 This is a text</p>
 ````````````````````````````````
 
-Front matter ends with the first line containing three dots `...` or three dashes `...`:
+Front matter ends with the first line containing three dots `...` or three dashes `---`:
 
 ```````````````````````````````` example
 ---

src/Markdig.Tests/TestConfigureNewLine.cs

@@ -21,5 +21,22 @@ namespace Markdig.Tests
             var actual = Markdown.ToHtml(markdownText, pipeline);
             Assert.AreEqual(expected, actual);
         }
+
+        [Test]
+        [TestCase(/* newLineForWriting: */ "\n",   /* markdownText: */ "*1*\n*2*\n",     /* expected: */ "1\n2\n")]
+        [TestCase(/* newLineForWriting: */ "\n",   /* markdownText: */ "*1*\r\n*2*\r\n", /* expected: */ "1\n2\n")]
+        [TestCase(/* newLineForWriting: */ "\r\n", /* markdownText: */ "*1*\n*2*\n",     /* expected: */ "1\r\n2\r\n")]
+        [TestCase(/* newLineForWriting: */ "\r\n", /* markdownText: */ "*1*\r\n*2*\r\n", /* expected: */ "1\r\n2\r\n")]
+        [TestCase(/* newLineForWriting: */ "!!!", /* markdownText: */ "*1*\n*2*\n",     /* expected: */ "1!!!2!!!")]
+        [TestCase(/* newLineForWriting: */ "!!!", /* markdownText: */ "*1*\r\n*2*\r\n", /* expected: */ "1!!!2!!!")]
+        public void TestPlainOutputWhenConfiguringNewLine(string newLineForWriting, string markdownText, string expected)
+        {
+            var pipeline = new MarkdownPipelineBuilder()
+                .ConfigureNewLine(newLineForWriting)
+                .Build();
+
+            var actual = Markdown.ToPlainText(markdownText, pipeline);
+            Assert.AreEqual(expected, actual);
+        }
     }
 }

src/Markdig.Tests/TestImageAltText.cs

@@ -0,0 +1,25 @@
+using NUnit.Framework;
+using System.Text.RegularExpressions;
+
+namespace Markdig.Tests
+{
+    [TestFixture]
+    public class TestImageAltText
+    {
+        [Test]
+        [TestCase("![](image.jpg)", "")]
+        [TestCase("![foo](image.jpg)", "foo")]
+        [TestCase("![][1]\n\n[1]: image.jpg", "")]
+        [TestCase("![bar][1]\n\n[1]: image.jpg", "bar")]
+        [TestCase("![](image.jpg 'title')", "")]
+        [TestCase("![foo](image.jpg 'title')", "foo")]
+        [TestCase("![][1]\n\n[1]: image.jpg 'title'", "")]
+        [TestCase("![bar][1]\n\n[1]: image.jpg 'title'", "bar")]
+        public void TestImageHtmlAltText(string markdown, string expectedAltText)
+        {
+            string html = Markdown.ToHtml(markdown);
+            string actualAltText = Regex.Match(html, "alt=\"(.*?)\"").Groups[1].Value;
+            Assert.AreEqual(expectedAltText, actualAltText);
+        }
+    }
+}

src/Markdig.Tests/TestPlainText.cs

@@ -9,9 +9,30 @@ namespace Markdig.Tests
         public void TestPlain()
         {
             var markdownText = "*Hello*, [world](http://example.com)!";
-            var expected = "Hello, world!";
+            var expected = "Hello, world!\n";
             var actual = Markdown.ToPlainText(markdownText);
             Assert.AreEqual(expected, actual);
         }
+
+        [Test]
+        [TestCase(/* markdownText: */ "foo bar", /* expected: */ "foo bar\n")]
+        [TestCase(/* markdownText: */ "foo\nbar", /* expected: */ "foo\nbar\n")]
+        [TestCase(/* markdownText: */ "*foo\nbar*", /* expected: */ "foo\nbar\n")]
+        [TestCase(/* markdownText: */ "[foo\nbar](http://example.com)", /* expected: */ "foo\nbar\n")]
+        [TestCase(/* markdownText: */ "<http://foo.bar.baz>", /* expected: */ "http://foo.bar.baz\n")]
+        [TestCase(/* markdownText: */ "# foo bar", /* expected: */ "foo bar\n")]
+        [TestCase(/* markdownText: */ "# foo\nbar", /* expected: */ "foo\nbar\n")]
+        [TestCase(/* markdownText: */ "> foo", /* expected: */ "foo\n")]
+        [TestCase(/* markdownText: */ "> foo\nbar\n> baz", /* expected: */ "foo\nbar\nbaz\n")]
+        [TestCase(/* markdownText: */ "`foo`", /* expected: */ "foo\n")]        
+        [TestCase(/* markdownText: */ "`foo\nbar`", /* expected: */ "foo bar\n")] // new line within codespan is treated as whitespace (Example317)
+        [TestCase(/* markdownText: */ "```\nfoo bar\n```", /* expected: */ "foo bar\n")]
+        [TestCase(/* markdownText: */ "- foo\n- bar\n- baz", /* expected: */ "foo\nbar\nbaz\n")]
+        public void TestPlainEnsureNewLine(string markdownText, string expected)
+        {            
+            var actual = Markdown.ToPlainText(markdownText);
+            Assert.AreEqual(expected, actual);
+        }
+
     }
 }

src/Markdig/Extensions/AutoIdentifiers/AutoIdentifierOptions.cs

@@ -12,7 +12,7 @@ namespace Markdig.Extensions.AutoIdentifiers
     public enum AutoIdentifierOptions
     {
         /// <summary>
-        /// No options
+        /// No options: does not apply any additional formatting and/or transformations.  
         /// </summary>
         None = 0,
 
@@ -36,4 +36,4 @@ namespace Markdig.Extensions.AutoIdentifiers
         /// </summary>
         GitHub = 4,
     }
-}
+}

src/Markdig/Extensions/AutoLinks/AutoLinkExtension.cs

@@ -14,12 +14,19 @@ namespace Markdig.Extensions.AutoLinks
     /// <seealso cref="Markdig.IMarkdownExtension" />
     public class AutoLinkExtension : IMarkdownExtension
     {
+        public readonly string ValidPreviousCharacters;
+
+        public AutoLinkExtension(string validPreviousCharacters = AutoLinkParser.DefaultValidPreviousCharacters)
+        {
+            ValidPreviousCharacters = validPreviousCharacters;
+        }
+
         public void Setup(MarkdownPipelineBuilder pipeline)
         {
             if (!pipeline.InlineParsers.Contains<AutoLinkParser>())
             {
                 // Insert the parser before any other parsers
-                pipeline.InlineParsers.Insert(0, new AutoLinkParser());
+                pipeline.InlineParsers.Insert(0, new AutoLinkParser(ValidPreviousCharacters));
             }
         }
 

src/Markdig/Extensions/AutoLinks/AutoLinkParser.cs

@@ -3,7 +3,7 @@
 // See the license.txt file in the project root for more information.
 
 using System;
-using System.Collections.Generic;
+using System.Collections.Generic;
 using Markdig.Helpers;
 using Markdig.Parsers;
 using Markdig.Syntax.Inlines;
@@ -19,7 +19,7 @@ namespace Markdig.Extensions.AutoLinks
         /// <summary>
         /// Initializes a new instance of the <see cref="AutoLinkParser"/> class.
         /// </summary>
-        public AutoLinkParser()
+        public AutoLinkParser(string validPreviousCharacters = DefaultValidPreviousCharacters)
         {
             OpeningCharacters = new char[]
             {
@@ -28,20 +28,19 @@ namespace Markdig.Extensions.AutoLinks
                 'm', // for mailto:
                 'w', // for www.
             };
+
+            ValidPreviousCharacters = validPreviousCharacters;
         }
 
-
-        private static bool IsValidPreviousCharacter(char c)
-        {
-            // All such recognized autolinks can only come at the beginning of a line, after whitespace, or any of the delimiting characters *, _, ~, and (.
-            return c.IsWhiteSpaceOrZero() || c == '*' || c == '_' || c == '~' || c == '(';
-        }
+        // All such recognized autolinks can only come at the beginning of a line, after whitespace, or any of the delimiting characters *, _, ~, and (.
+        public readonly string ValidPreviousCharacters;
+        public const string DefaultValidPreviousCharacters = "*_~(";
 
         public override bool Match(InlineProcessor processor, ref StringSlice slice)
         {
             // Previous char must be a whitespace or a punctuation
             var previousChar = slice.PeekCharExtra(-1);
-            if (!IsValidPreviousCharacter(previousChar))
+            if (!previousChar.IsWhiteSpaceOrZero() && ValidPreviousCharacters.IndexOf(previousChar) == -1)
             {
                 return false;
             }
@@ -54,22 +53,29 @@ namespace Markdig.Extensions.AutoLinks
             }
 
             var startPosition = slice.Start;
+            int domainOffset = 0;
 
             var c = slice.CurrentChar;
             // Precheck URL
             switch (c)
             {
                 case 'h':
-                    if (!slice.MatchLowercase("ttp://", 1) && !slice.MatchLowercase("ttps://", 1))
-                    {
-                        return false;
+                    if (slice.MatchLowercase("ttp://", 1))
+                    {
+                        domainOffset = 7; // http://
                     }
+                    else if (slice.MatchLowercase("ttps://", 1))
+                    {
+                        domainOffset = 8; // https://
+                    }
+                    else return false;
                     break;
                 case 'f':
                     if (!slice.MatchLowercase("tp://", 1))
                     {
                         return false;
                     }
+                    domainOffset = 6; // ftp://
                     break;
                 case 'm':
                     if (!slice.MatchLowercase("ailto:", 1))
@@ -83,6 +89,7 @@ namespace Markdig.Extensions.AutoLinks
                     {
                         return false;
                     }
+                    domainOffset = 4; // www.
                     break;
             }
 
@@ -131,19 +138,19 @@ namespace Markdig.Extensions.AutoLinks
                     }
                     break;
                 case 'm':
-                    if (string.Equals(link, "mailto:", StringComparison.OrdinalIgnoreCase) || !link.Contains("@"))
+                    int atIndex = link.IndexOf('@');
+                    if (atIndex == -1 ||
+                        atIndex == 7) // mailto:@ - no email part
                     {
-                        return false;
+                        return false;
                     }
+                    domainOffset = atIndex + 1;
                     break;
+            }
 
-                case 'w':
-                    // We require at least two .
-                    if (link.Length <= "www.x.y".Length || link.IndexOf(".", 4, StringComparison.Ordinal) < 0)
-                    {
-                        return false;
-                    }
-                    break;
+            if (!LinkHelper.IsValidDomain(link, domainOffset))
+            {
+                return false;
             }
 
             int line;

src/Markdig/Helpers/LinkHelper.cs

@@ -3,8 +3,6 @@
 // See the license.txt file in the project root for more information.
 using System;
 using System.Runtime.CompilerServices;
-using System.Text;
-using Markdig.Parsers.Inlines;
 using Markdig.Syntax;
 
 namespace Markdig.Helpers
@@ -666,6 +664,54 @@ namespace Markdig.Helpers
             return c == '\0' || c.IsSpaceOrTab() || c.IsControl() || (isAutoLink && c == '<'); // TODO: specs unclear. space is strict or relaxed? (includes tabs?)
         }
 
+        public static bool IsValidDomain(string link, int prefixLength)
+        {
+            // https://github.github.com/gfm/#extended-www-autolink
+            // A valid domain consists of alphanumeric characters, underscores (_), hyphens (-) and periods (.).
+            // There must be at least one period, and no underscores may be present in the last two segments of the domain.
+
+            int segmentCount = 1;
+            bool segmentHasCharacters = false;
+            int lastUnderscoreSegment = -1;
+
+            for (int i = prefixLength; i < link.Length; i++)
+            {
+                char c = link[i];
+
+                if (c == '.') // New segment
+                {
+                    if (!segmentHasCharacters)
+                        return false;
+
+                    segmentCount++;
+                    segmentHasCharacters = false;
+                    continue;
+                }
+
+                if (!c.IsAlphaNumeric())
+                {
+                    if (c == '/' || c == '?' || c == '#' || c == ':') // End of domain name
+                        break;
+
+                    if (c == '_')
+                    {
+                        lastUnderscoreSegment = segmentCount;
+                    }
+                    else if (c != '-')
+                    {
+                        // An invalid character has been found
+                        return false;
+                    }
+                }
+
+                segmentHasCharacters = true;
+            }
+
+            return segmentCount != 1 && // At least one dot was present
+                segmentHasCharacters && // Last segment has valid characters
+                segmentCount - lastUnderscoreSegment >= 2; // No underscores are present in the last two segments of the domain
+        }
+
         public static bool TryParseLinkReferenceDefinition<T>(T text, out string label, out string url,
             out string title) where T : ICharIterator
         {
@@ -785,7 +831,6 @@ namespace Markdig.Helpers
             return TryParseLabel(ref lines, false, out label, out labelSpan);
         }
 
-
         public static bool TryParseLabel<T>(ref T lines, out string label, out SourceSpan labelSpan) where T : ICharIterator
         {
             return TryParseLabel(ref lines, false, out label, out labelSpan);

src/Markdig/Helpers/OrderedList.cs

@@ -1,4 +1,4 @@
-// Copyright (c) Alexandre Mutel. All rights reserved.
+// Copyright (c) Alexandre Mutel. All rights reserved.
 // This file is licensed under the BSD-Clause 2 license. 
 // See the license.txt file in the project root for more information.
 using System;
@@ -121,5 +121,20 @@ namespace Markdig.Helpers
             }
             return false;
         }
+
+        /// <summary>
+        /// Replaces <typeparamref name="TElement"/> with <paramref name="newElement"/> or adds <paramref name="newElement"/>.
+        /// </summary>
+        /// <typeparam name="TElement">Element type to find in the list</typeparam>
+        /// <param name="newElement">Object to add/replace the found element with</param>
+        /// <returns><c>true</c> if a replacement was made; otherwise <c>false</c>.</returns>
+        public bool ReplaceOrAdd<TElement>(T newElement) where TElement : T
+        {
+            if (Replace<TElement>(newElement))
+                return true;
+
+            Add(newElement);
+            return false;
+        }
     }
 }

src/Markdig/Markdig.csproj

@@ -5,7 +5,7 @@
     <Copyright>Alexandre Mutel</Copyright>
     <AssemblyTitle>Markdig</AssemblyTitle>
     <NeutralLanguage>en-US</NeutralLanguage>
-    <VersionPrefix>0.15.3</VersionPrefix>
+    <VersionPrefix>0.15.5</VersionPrefix>
     <Authors>Alexandre Mutel</Authors>
     <TargetFrameworks>net35;net40;portable40-net40+sl5+win8+wp8+wpa81;netstandard1.1;netstandard2.0;uap10.0</TargetFrameworks>
     <AssemblyName>Markdig</AssemblyName>

src/Markdig/MarkdownExtensions.cs

@@ -99,9 +99,9 @@ namespace Markdig
         /// </summary>
         /// <param name="pipeline">The pipeline.</param>
         /// <returns>The modified pipeline</returns>
-        public static MarkdownPipelineBuilder UseAutoLinks(this MarkdownPipelineBuilder pipeline)
+        public static MarkdownPipelineBuilder UseAutoLinks(this MarkdownPipelineBuilder pipeline, string validPreviousCharacters = AutoLinkParser.DefaultValidPreviousCharacters)
         {
-            pipeline.Extensions.AddIfNotAlready<AutoLinkExtension>();
+            pipeline.Extensions.ReplaceOrAdd<AutoLinkExtension>(new AutoLinkExtension(validPreviousCharacters));
             return pipeline;
         }
 

src/Markdig/Parsers/Inlines/LinkInlineParser.cs

@@ -136,7 +136,7 @@ namespace Markdig.Parsers.Inlines
                     {
                         child = new LiteralInline()
                         {
-                            Content = new StringSlice(label),
+                            Content = StringSlice.Empty,
                             IsClosed = true,
                             // Not exact but we leave it like this
                             Span = parent.Span,

src/Markdig/Renderers/Html/CodeBlockRenderer.cs

@@ -87,6 +87,8 @@ namespace Markdig.Renderers.Html
                     renderer.WriteLine("</code></pre>");
                 }
             }
+
+            renderer.EnsureLine();
         }
     }
 }

src/Markdig/Renderers/Html/HeadingRenderer.cs

@@ -38,6 +38,8 @@ namespace Markdig.Renderers.Html
             {
                 renderer.Write("</").Write(headingText).WriteLine(">");
             }
+
+            renderer.EnsureLine();
         }
     }
 }

src/Markdig/Renderers/Html/Inlines/LineBreakInlineRenderer.cs

@@ -24,15 +24,9 @@ namespace Markdig.Renderers.Html.Inlines
                 {
                     renderer.WriteLine("<br />");
                 }
-                else
-                {
-                    renderer.WriteLine();
-                }
-            }
-            else
-            {
-                renderer.Write(" ");
             }
+
+            renderer.EnsureLine();
         }
     }
 }

src/Markdig/Renderers/Html/ListRenderer.cs

@@ -59,6 +59,7 @@ namespace Markdig.Renderers.Html
                     renderer.WriteLine("</li>");
                 }
 
+                renderer.EnsureLine();
                 renderer.ImplicitParagraph = previousImplicit;
             }
 
@@ -66,6 +67,8 @@ namespace Markdig.Renderers.Html
             {
                 renderer.WriteLine(listBlock.IsOrdered ? "</ol>" : "</ul>");
             }
+
+            renderer.EnsureLine();
         }
     }
 }

src/Markdig/Renderers/Html/ParagraphRenderer.cs

@@ -23,9 +23,14 @@ namespace Markdig.Renderers.Html
                 renderer.Write("<p").WriteAttributes(obj).Write(">");
             }
             renderer.WriteLeafInline(obj);
-            if (!renderer.ImplicitParagraph && renderer.EnableHtmlForBlock)
+            if (!renderer.ImplicitParagraph)
             {
-                renderer.WriteLine("</p>");
+                if(renderer.EnableHtmlForBlock)
+                {
+                    renderer.WriteLine("</p>");
+                }
+
+                renderer.EnsureLine();
             }
         }
     }

src/Markdig/Renderers/Html/QuoteBlockRenderer.cs

@@ -26,6 +26,7 @@ namespace Markdig.Renderers.Html
             {
                 renderer.WriteLine("</blockquote>");
             }
+            renderer.EnsureLine();
         }
     }
 }