Xjyuk

Why is 'additive' EQ more difficult to use than 'subtractive'?

Of strange atmospheres - the survivable but unbreathable

Why isn't 'chemically-strengthened glass' made with potassium carbonate? To begin with?

Best shape for a necromancer's undead minions for battle?

Did this character show any indication of wanting to rule before S8E6?

Underwater city sanitation

Is "vegetable base" a common term in English?

One word for 'the thing that attracts me'?

What did the 'turbo' button actually do?

Time complexity of an algorithm: Is it important to state the base of the logarithm?

Is there a simple example that empirical evidence is misleading?

Why does Bran want to find Drogon?

How to deceive the MC

How can I properly write this equation in Latex?

Is it legal to have an abortion in another state or abroad?

What is the intuition behind the term Transitive for verbs?

Testing using real data of the customer

...And they were stumped for a long time

Why is unzipped directory exactly 4.0k (much smaller than zipped file)?

What is the difference between LORD and GOD?

A burglar's sunglasses, a lady's odyssey

Are there any German nonsense poems (Jabberwocky)?

Freedom of Speech and Assembly in China

Count all vowels in string

Filter YAML file content using sed/awk

Sed + how to set parameters in sed command in order to display lines from text filefilter based on a field value in awkHow can I add a column to a specific position in a csv file using cat, sed, awk or cut?How well does grep/sed/awk perform on very large files?sed/awk replace a specific pattern under another patternRegex: using awk and sed to match websites by IPvalidate file content with bash Regular Expressionsecho line with var that contains few linesextract field from file using sed or awkHow to print one line below the matching RegEx in AWK or SED

.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;

2

I have a text file with the following content in it.

$ cat hosts.yml
[prod_env]
foo.example.com
bar.example.com
[stage_env]
foo_stage.example.com
bar_stage.example.com
[dev_env]
foo_dev1.example.com
dev2_bar.example.com

I would like to filter hosts listed under [prod_env] file in bash.
I tried with sed, awk and grep with my limited knowledge, but I am not sure how to filter them.

Example: I would like to print hosts under prod_env and dev_env. so the final output would be:

foo.example.com 
bar.example.com 
foo_dev1.example.com 
dev2_bar.example.com

awk sed yaml

share|improve this question

edited 5 hours ago

Jeff Schaller♦

46k1165150

asked 8 hours ago

smcsmc

205210

add a comment | 

2

I have a text file with the following content in it.

$ cat hosts.yml
[prod_env]
foo.example.com
bar.example.com
[stage_env]
foo_stage.example.com
bar_stage.example.com
[dev_env]
foo_dev1.example.com
dev2_bar.example.com

I would like to filter hosts listed under [prod_env] file in bash.
I tried with sed, awk and grep with my limited knowledge, but I am not sure how to filter them.

Example: I would like to print hosts under prod_env and dev_env. so the final output would be:

foo.example.com 
bar.example.com 
foo_dev1.example.com 
dev2_bar.example.com

awk sed yaml

share|improve this question

edited 5 hours ago

Jeff Schaller♦

46k1165150

asked 8 hours ago

smcsmc

205210

add a comment | 

I have a text file with the following content in it.

$ cat hosts.yml
[prod_env]
foo.example.com
bar.example.com
[stage_env]
foo_stage.example.com
bar_stage.example.com
[dev_env]
foo_dev1.example.com
dev2_bar.example.com

I would like to filter hosts listed under [prod_env] file in bash.
I tried with sed, awk and grep with my limited knowledge, but I am not sure how to filter them.

Example: I would like to print hosts under prod_env and dev_env. so the final output would be:

foo.example.com 
bar.example.com 
foo_dev1.example.com 
dev2_bar.example.com

awk sed yaml

share|improve this question

edited 5 hours ago

Jeff Schaller♦

46k1165150

asked 8 hours ago

smcsmc

205210

$ cat hosts.yml
[prod_env]
foo.example.com
bar.example.com
[stage_env]
foo_stage.example.com
bar_stage.example.com
[dev_env]
foo_dev1.example.com
dev2_bar.example.com

foo.example.com 
bar.example.com 
foo_dev1.example.com 
dev2_bar.example.com

share|improve this question

edited 5 hours ago

Jeff Schaller♦

46k1165150

asked 8 hours ago

smcsmc

205210

share|improve this question

edited 5 hours ago

Jeff Schaller♦

46k1165150

asked 8 hours ago

smcsmc

205210

edited 5 hours ago

Jeff Schaller♦

46k1165150

edited 5 hours ago

Jeff Schaller♦

46k1165150

asked 8 hours ago

smcsmc

205210

asked 8 hours ago

smcsmc

205210

3 Answers
3

active

oldest

votes

3

An sed solution:

sed -nEe '/[(prod|dev)_env]/!d;N;:loop' -e 's/.*n//;$p;d;;N;P;/n[/D;bloop' hosts.yml

• 
  /[(prod|dev)_env]/!d drops all lines until [prod_env] or [dev_env] ist found


• 
  N;:loop adds the next line and starts a loop


• inside the loop we remove the first of the two lines with s/.*n//, because it is either the [...env] line or we already printed it in the last loop cycle


• 
  $p;d; prints the remaining lines if we reached the last line while printing


• 
  N;P adds the next line and prints the current one


• 
  /n[/D looks if the next line starts with a [. In this case the first line in the buffer (already printed) can be discarded and we start over with that [ line


• 
  bloop otherwise loop

Instead of adding the next line to the buffer, printing and removing the old one, you can go line by line, but this would require another loop, because you can't start over with D

share|improve this answer

edited 6 hours ago

answered 6 hours ago

PhilipposPhilippos

6,46811851

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Thanks for the awesome explanation, this once again reminds me how powerful sed is.
  
  – smc
  6 hours ago
  

  
  
  
  

add a comment | 

2

You could do (on a mac):

tr "n" "t" < hosts.yml | sed $'s%t\[%\n[%g' | grep 'prod|dev' | sed $'s%.*]\t%%g' | tr "t" "n"

1. 
   tr will get everything on one line


2. The first sed will
   break line before each section


3. 
   grep will cut out the lines
   (sections) you want


4. Second sed will remove the [] part.


5. Last tr will break line so you get one hostname per line.

share|improve this answer

answered 7 hours ago

Søren FalchSøren Falch

211

New contributor

Søren Falch is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

add a comment | 

2

awk 'BEGINRS="[";FS="]n" 
 $1 ~/(prod|dev)_env/ print $2' ex1

share|improve this answer

answered 6 hours ago

JJoaoJJoao

7,5691930

add a comment | 

Your Answer

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "106"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);

Sign up using Google

Sign up using Facebook

Sign up using Email and Password

Post as a guest

Name

Email

Required, but never shown

StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f520209%2ffilter-yaml-file-content-using-sed-awk%23new-answer', 'question_page');

);

Post as a guest

Name

Email

Required, but never shown

3

An sed solution:

sed -nEe '/[(prod|dev)_env]/!d;N;:loop' -e 's/.*n//;$p;d;;N;P;/n[/D;bloop' hosts.yml

• 
  /[(prod|dev)_env]/!d drops all lines until [prod_env] or [dev_env] ist found


• 
  N;:loop adds the next line and starts a loop


• inside the loop we remove the first of the two lines with s/.*n//, because it is either the [...env] line or we already printed it in the last loop cycle


• 
  $p;d; prints the remaining lines if we reached the last line while printing


• 
  N;P adds the next line and prints the current one


• 
  /n[/D looks if the next line starts with a [. In this case the first line in the buffer (already printed) can be discarded and we start over with that [ line


• 
  bloop otherwise loop

Instead of adding the next line to the buffer, printing and removing the old one, you can go line by line, but this would require another loop, because you can't start over with D

share|improve this answer

edited 6 hours ago

answered 6 hours ago

PhilipposPhilippos

6,46811851

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Thanks for the awesome explanation, this once again reminds me how powerful sed is.
  
  – smc
  6 hours ago
  

  
  
  
  

add a comment | 

3

An sed solution:

sed -nEe '/[(prod|dev)_env]/!d;N;:loop' -e 's/.*n//;$p;d;;N;P;/n[/D;bloop' hosts.yml

• 
  /[(prod|dev)_env]/!d drops all lines until [prod_env] or [dev_env] ist found


• 
  N;:loop adds the next line and starts a loop


• inside the loop we remove the first of the two lines with s/.*n//, because it is either the [...env] line or we already printed it in the last loop cycle


• 
  $p;d; prints the remaining lines if we reached the last line while printing


• 
  N;P adds the next line and prints the current one


• 
  /n[/D looks if the next line starts with a [. In this case the first line in the buffer (already printed) can be discarded and we start over with that [ line


• 
  bloop otherwise loop

Instead of adding the next line to the buffer, printing and removing the old one, you can go line by line, but this would require another loop, because you can't start over with D

share|improve this answer

edited 6 hours ago

answered 6 hours ago

PhilipposPhilippos

6,46811851

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Thanks for the awesome explanation, this once again reminds me how powerful sed is.
  
  – smc
  6 hours ago
  

  
  
  
  

add a comment | 

An sed solution:

sed -nEe '/[(prod|dev)_env]/!d;N;:loop' -e 's/.*n//;$p;d;;N;P;/n[/D;bloop' hosts.yml

• 
  /[(prod|dev)_env]/!d drops all lines until [prod_env] or [dev_env] ist found


• 
  N;:loop adds the next line and starts a loop


• inside the loop we remove the first of the two lines with s/.*n//, because it is either the [...env] line or we already printed it in the last loop cycle


• 
  $p;d; prints the remaining lines if we reached the last line while printing


• 
  N;P adds the next line and prints the current one


• 
  /n[/D looks if the next line starts with a [. In this case the first line in the buffer (already printed) can be discarded and we start over with that [ line


• 
  bloop otherwise loop

Instead of adding the next line to the buffer, printing and removing the old one, you can go line by line, but this would require another loop, because you can't start over with D

share|improve this answer

edited 6 hours ago

answered 6 hours ago

PhilipposPhilippos

6,46811851

sed -nEe '/[(prod|dev)_env]/!d;N;:loop' -e 's/.*n//;$p;d;;N;P;/n[/D;bloop' hosts.yml

share|improve this answer

edited 6 hours ago

answered 6 hours ago

PhilipposPhilippos

6,46811851

answered 6 hours ago

PhilipposPhilippos

6,46811851

answered 6 hours ago

PhilipposPhilippos

6,46811851

2

You could do (on a mac):

tr "n" "t" < hosts.yml | sed $'s%t\[%\n[%g' | grep 'prod|dev' | sed $'s%.*]\t%%g' | tr "t" "n"

1. 
   tr will get everything on one line


2. The first sed will
   break line before each section


3. 
   grep will cut out the lines
   (sections) you want


4. Second sed will remove the [] part.


5. Last tr will break line so you get one hostname per line.

share|improve this answer

answered 7 hours ago

Søren FalchSøren Falch

211

New contributor

Søren Falch is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

add a comment | 

2

You could do (on a mac):

tr "n" "t" < hosts.yml | sed $'s%t\[%\n[%g' | grep 'prod|dev' | sed $'s%.*]\t%%g' | tr "t" "n"

1. 
   tr will get everything on one line


2. The first sed will
   break line before each section


3. 
   grep will cut out the lines
   (sections) you want


4. Second sed will remove the [] part.


5. Last tr will break line so you get one hostname per line.

share|improve this answer

answered 7 hours ago

Søren FalchSøren Falch

211

New contributor

Søren Falch is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

add a comment | 

You could do (on a mac):

tr "n" "t" < hosts.yml | sed $'s%t\[%\n[%g' | grep 'prod|dev' | sed $'s%.*]\t%%g' | tr "t" "n"

1. 
   tr will get everything on one line


2. The first sed will
   break line before each section


3. 
   grep will cut out the lines
   (sections) you want


4. Second sed will remove the [] part.


5. Last tr will break line so you get one hostname per line.

share|improve this answer

answered 7 hours ago

Søren FalchSøren Falch

211

New contributor

Søren Falch is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

tr "n" "t" < hosts.yml | sed $'s%t\[%\n[%g' | grep 'prod|dev' | sed $'s%.*]\t%%g' | tr "t" "n"

share|improve this answer

answered 7 hours ago

Søren FalchSøren Falch

211

New contributor

Søren Falch is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

answered 7 hours ago

Søren FalchSøren Falch

211

New contributor

Søren Falch is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

answered 7 hours ago

Søren FalchSøren Falch

211

2

awk 'BEGINRS="[";FS="]n" 
 $1 ~/(prod|dev)_env/ print $2' ex1

share|improve this answer

answered 6 hours ago

JJoaoJJoao

7,5691930

add a comment | 

2

awk 'BEGINRS="[";FS="]n" 
 $1 ~/(prod|dev)_env/ print $2' ex1

share|improve this answer

answered 6 hours ago

JJoaoJJoao

7,5691930

add a comment | 

awk 'BEGINRS="[";FS="]n" 
 $1 ~/(prod|dev)_env/ print $2' ex1

share|improve this answer

answered 6 hours ago

JJoaoJJoao

7,5691930

awk 'BEGINRS="[";FS="]n" 
 $1 ~/(prod|dev)_env/ print $2' ex1

share|improve this answer

answered 6 hours ago

JJoaoJJoao

7,5691930

answered 6 hours ago

JJoaoJJoao

7,5691930

answered 6 hours ago

JJoaoJJoao

7,5691930