curlurl

package module

v0.0.0-...-8e3b0ea Latest Latest Go to latest Published: Oct 9, 2017 License: MIT Imports: 4 Imported by: 1

Details

Valid go.mod file
Redistributable license
Tagged version
Stable version
Learn more about best practices

Repository

github.com/suntong/curlurl

Links

Open Source Insights

README ¶

curlurl

curlurl - curl like url glob handling in Go

For input like site.{one,two,three}[1-3].com, it gives

site.one1.com
site.one2.com
site.one3.com
site.two1.com
site.two2.com
site.two3.com
site.three1.com
site.three2.com
site.three3.com

For input like https://site.{one,two,three}.com/prj[1-3]-{one,two,three}/[8-10], it gives

https://site.one.com/prj1-one/8
https://site.one.com/prj1-one/9
https://site.one.com/prj1-one/10
https://site.one.com/prj1-two/8
https://site.one.com/prj1-two/9
https://site.one.com/prj1-two/10
https://site.one.com/prj1-three/8
https://site.one.com/prj1-three/9
https://site.one.com/prj1-three/10
https://site.one.com/prj2-one/8
https://site.one.com/prj2-one/9
https://site.one.com/prj2-one/10
https://site.one.com/prj2-two/8
https://site.one.com/prj2-two/9
https://site.one.com/prj2-two/10
https://site.one.com/prj2-three/8
https://site.one.com/prj2-three/9
https://site.one.com/prj2-three/10
https://site.one.com/prj3-one/8
https://site.one.com/prj3-one/9
https://site.one.com/prj3-one/10
https://site.one.com/prj3-two/8
https://site.one.com/prj3-two/9
https://site.one.com/prj3-two/10
https://site.one.com/prj3-three/8
https://site.one.com/prj3-three/9
https://site.one.com/prj3-three/10
https://site.two.com/prj1-one/8
https://site.two.com/prj1-one/9
https://site.two.com/prj1-one/10
https://site.two.com/prj1-two/8
https://site.two.com/prj1-two/9
https://site.two.com/prj1-two/10
https://site.two.com/prj1-three/8
https://site.two.com/prj1-three/9
https://site.two.com/prj1-three/10
https://site.two.com/prj2-one/8
https://site.two.com/prj2-one/9
https://site.two.com/prj2-one/10
https://site.two.com/prj2-two/8
https://site.two.com/prj2-two/9
https://site.two.com/prj2-two/10
https://site.two.com/prj2-three/8
https://site.two.com/prj2-three/9
https://site.two.com/prj2-three/10
https://site.two.com/prj3-one/8
https://site.two.com/prj3-one/9
https://site.two.com/prj3-one/10
https://site.two.com/prj3-two/8
https://site.two.com/prj3-two/9
https://site.two.com/prj3-two/10
https://site.two.com/prj3-three/8
https://site.two.com/prj3-three/9
https://site.two.com/prj3-three/10
https://site.three.com/prj1-one/8
https://site.three.com/prj1-one/9
https://site.three.com/prj1-one/10
https://site.three.com/prj1-two/8
https://site.three.com/prj1-two/9
https://site.three.com/prj1-two/10
https://site.three.com/prj1-three/8
https://site.three.com/prj1-three/9
https://site.three.com/prj1-three/10
https://site.three.com/prj2-one/8
https://site.three.com/prj2-one/9
https://site.three.com/prj2-one/10
https://site.three.com/prj2-two/8
https://site.three.com/prj2-two/9
https://site.three.com/prj2-two/10
https://site.three.com/prj2-three/8
https://site.three.com/prj2-three/9
https://site.three.com/prj2-three/10
https://site.three.com/prj3-one/8
https://site.three.com/prj3-one/9
https://site.three.com/prj3-one/10
https://site.three.com/prj3-two/8
https://site.three.com/prj3-two/9
https://site.three.com/prj3-two/10
https://site.three.com/prj3-three/8
https://site.three.com/prj3-three/9
https://site.three.com/prj3-three/10

Author(s) & Contributor(s)

Tong SUN

All patches welcome.

Documentation ¶

Index ¶

Constants
func Prefix(in []string, prefix string) (ret []string)
type URLGlob
- func NewURLGlob(hosts string) *URLGlob
type URLPattern

Constants ¶

View Source

const (
	// URLPlain stands for the part of url is of plain text
	URLPlain = iota
	// URLSet stands for the part of url is of a set, e.g., `{one,two,three}`
	URLSet
	// URLRange stands for the part of url is of a range, e.g., `[1-100]`
	URLRange
)

Variables ¶

This section is empty.

Functions ¶

func Prefix ¶

func Prefix(in []string, prefix string) (ret []string)

Prefix prefixes the given slice with the given prefix for each element

Types ¶

type URLGlob ¶

type URLGlob struct {
	URL string
	// contains filtered or unexported fields
}

URLGlob is used for url glob transformation.

func NewURLGlob ¶

func NewURLGlob(hosts string) *URLGlob

NewURLGlob creates a new URLGlob

func (*URLGlob) GetURLs ¶

func (g *URLGlob) GetURLs(ndx int) (ret []string)

GetURLs will get URLs from the parsed urlGlob slice

Example (Errors) ¶

getURLsTest("site[8].com")
getURLsTest("site[8-].com")
getURLsTest("site[8-a].com")

Output:
-
site[8].com
Error, Range expression parsing: Wrong range format
-
site[8-].com
Error, Range expression num range not match: strconv.Atoi: parsing "": invalid syntax
[{0 [site]} {2 []} {0 [.com]}]
[]
-
site[8-a].com
Error, Range expression num range not match: strconv.Atoi: parsing "a": invalid syntax
[{0 [site]} {2 []} {0 [.com]}]
[]

Example (Output) ¶

getURLsTest("google.ca")
getURLsTest("site.{one,two,three}.com")
getURLsTest("site.{one,two,three}")
getURLsTest("site[1-3].com")
getURLsTest("site.{one,two,three}[1-3].com")
getURLsTest("site.{one,two,three}[1-3]")
getURLsTest("{one,two,three}[1-3]")
getURLsTest("https://site.{one,two,three}.com/prj[1-3]-{one,two,three}/[8-10]")

Output:
-
google.ca
[{0 [google.ca]}]
[google.ca]
-
site.{one,two,three}.com
[{0 [site.]} {1 [one two three]} {0 [.com]}]
[site.one.com site.two.com site.three.com]
-
site.{one,two,three}
[{0 [site.]} {1 [one two three]}]
[site.one site.two site.three]
-
site[1-3].com
[{0 [site]} {2 [1 2 3]} {0 [.com]}]
[site1.com site2.com site3.com]
-
site.{one,two,three}[1-3].com
[{0 [site.]} {1 [one two three]} {2 [1 2 3]} {0 [.com]}]
[site.one1.com site.one2.com site.one3.com site.two1.com site.two2.com site.two3.com site.three1.com site.three2.com site.three3.com]
-
site.{one,two,three}[1-3]
[{0 [site.]} {1 [one two three]} {2 [1 2 3]}]
[site.one1 site.one2 site.one3 site.two1 site.two2 site.two3 site.three1 site.three2 site.three3]
-
{one,two,three}[1-3]
[{1 [one two three]} {2 [1 2 3]}]
[one1 one2 one3 two1 two2 two3 three1 three2 three3]
-
https://site.{one,two,three}.com/prj[1-3]-{one,two,three}/[8-10]
[{0 [https://site.]} {1 [one two three]} {0 [.com/prj]} {2 [1 2 3]} {0 [-]} {1 [one two three]} {0 [/]} {2 [8 9 10]}]
[https://site.one.com/prj1-one/8 https://site.one.com/prj1-one/9 https://site.one.com/prj1-one/10 https://site.one.com/prj1-two/8 https://site.one.com/prj1-two/9 https://site.one.com/prj1-two/10 https://site.one.com/prj1-three/8 https://site.one.com/prj1-three/9 https://site.one.com/prj1-three/10 https://site.one.com/prj2-one/8 https://site.one.com/prj2-one/9 https://site.one.com/prj2-one/10 https://site.one.com/prj2-two/8 https://site.one.com/prj2-two/9 https://site.one.com/prj2-two/10 https://site.one.com/prj2-three/8 https://site.one.com/prj2-three/9 https://site.one.com/prj2-three/10 https://site.one.com/prj3-one/8 https://site.one.com/prj3-one/9 https://site.one.com/prj3-one/10 https://site.one.com/prj3-two/8 https://site.one.com/prj3-two/9 https://site.one.com/prj3-two/10 https://site.one.com/prj3-three/8 https://site.one.com/prj3-three/9 https://site.one.com/prj3-three/10 https://site.two.com/prj1-one/8 https://site.two.com/prj1-one/9 https://site.two.com/prj1-one/10 https://site.two.com/prj1-two/8 https://site.two.com/prj1-two/9 https://site.two.com/prj1-two/10 https://site.two.com/prj1-three/8 https://site.two.com/prj1-three/9 https://site.two.com/prj1-three/10 https://site.two.com/prj2-one/8 https://site.two.com/prj2-one/9 https://site.two.com/prj2-one/10 https://site.two.com/prj2-two/8 https://site.two.com/prj2-two/9 https://site.two.com/prj2-two/10 https://site.two.com/prj2-three/8 https://site.two.com/prj2-three/9 https://site.two.com/prj2-three/10 https://site.two.com/prj3-one/8 https://site.two.com/prj3-one/9 https://site.two.com/prj3-one/10 https://site.two.com/prj3-two/8 https://site.two.com/prj3-two/9 https://site.two.com/prj3-two/10 https://site.two.com/prj3-three/8 https://site.two.com/prj3-three/9 https://site.two.com/prj3-three/10 https://site.three.com/prj1-one/8 https://site.three.com/prj1-one/9 https://site.three.com/prj1-one/10 https://site.three.com/prj1-two/8 https://site.three.com/prj1-two/9 https://site.three.com/prj1-two/10 https://site.three.com/prj1-three/8 https://site.three.com/prj1-three/9 https://site.three.com/prj1-three/10 https://site.three.com/prj2-one/8 https://site.three.com/prj2-one/9 https://site.three.com/prj2-one/10 https://site.three.com/prj2-two/8 https://site.three.com/prj2-two/9 https://site.three.com/prj2-two/10 https://site.three.com/prj2-three/8 https://site.three.com/prj2-three/9 https://site.three.com/prj2-three/10 https://site.three.com/prj3-one/8 https://site.three.com/prj3-one/9 https://site.three.com/prj3-one/10 https://site.three.com/prj3-two/8 https://site.three.com/prj3-two/9 https://site.three.com/prj3-two/10 https://site.three.com/prj3-three/8 https://site.three.com/prj3-three/9 https://site.three.com/prj3-three/10]

func (*URLGlob) GlobRange ¶

func (g *URLGlob) GlobRange(submatch []string, abortOn errorHandling) []string

GlobRange handles range expression globing

func (*URLGlob) Parse ¶

func (g *URLGlob) Parse(abortOn errorHandling) *URLGlob

Parse will parse URL into urlGlob

type URLPattern ¶

type URLPattern struct {
	// contains filtered or unexported fields
}

The URLPattern holds the elements from url glob patterns.

Source Files ¶

View all Source files

urlglob.go

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL