Crawl only deeper not upwards in hierarchy #7

Open

Open

Crawl only deeper not upwards in hierarchy#7

Is it possible to only crawl deeper and not upwards in hierarchy or sideways?

So when i provide the url https://test.com/test1/test2/test3/ that the crawler only crawls everything under /test3/ but not things under /test2/ or higher?

to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests