ElasticSearch - Daily index mappingstructure when storing books in elasticsearchElasticsearch: Versioning a...
Does it makes sense to buy a new cycle to learn riding?
What do the Banks children have against barley water?
Landlord wants to switch my lease to a "Land contract" to "get back at the city"
Is it legal to have the "// (c) 2019 John Smith" header in all files when there are hundreds of contributors?
Need help identifying/translating a plaque in Tangier, Morocco
Finding files for which a command fails
"listening to me about as much as you're listening to this pole here"
Information to fellow intern about hiring?
What to wear for invited talk in Canada
Does a dangling wire really electrocute me if I'm standing in water?
Why was the "bread communication" in the arena of Catching Fire left out in the movie?
Is there a familial term for apples and pears?
Shall I use personal or official e-mail account when registering to external websites for work purpose?
What happens when a metallic dragon and a chromatic dragon mate?
Is Social Media Science Fiction?
How to deal with fear of taking dependencies
COUNT(*) or MAX(id) - which is faster?
Copycat chess is back
Why doesn't a const reference extend the life of a temporary object passed via a function?
How to manage monthly salary
Patience, young "Padovan"
Symmetry in quantum mechanics
New order #4: World
Can I legally use front facing blue light in the UK?
ElasticSearch - Daily index mapping
structure when storing books in elasticsearchElasticsearch: Versioning a document on revisionsElasticsearch and product characteristicsMongoDB or ElasticSearchchange analyzer for an elasticsearch index?Suggestions for type of DB to use (Elasticsearch vs MongoDB vs Hadoop)How to insert several csv files into Elasticsearch?Elasticsearch exceeded low water mark on only one nodeElasticsearch - Need to improve cluster performance, (sock hang up) happening a lot
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ margin-bottom:0;
}
Let's say i have an Index and I am want to create a daily index with an aliases.
Then I have some application that works against the elastic search(Mostly adding new documents to the index) and I am using Kibana to view and query against it.
So option number one for me is to have some separate Job which will run daily and create the index with its mapping and daily aliases. My problem here is that now my application is dependent on some outside job.
Option number two is before every insert to the ElasticSearch to check whether the Index exists(and if the mappings are current) and if not - to create it. Which seems to me worst then option 1 because of the overhead.
Any suggestions?
elasticsearch
asked Sep 18 '18 at 9:00
omriomri
234115
bumped to the homepage by Community♦ 16 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
Let's say i have an Index and I am want to create a daily index with an aliases.
Then I have some application that works against the elastic search(Mostly adding new documents to the index) and I am using Kibana to view and query against it.
So option number one for me is to have some separate Job which will run daily and create the index with its mapping and daily aliases. My problem here is that now my application is dependent on some outside job.
Option number two is before every insert to the ElasticSearch to check whether the Index exists(and if the mappings are current) and if not - to create it. Which seems to me worst then option 1 because of the overhead.
Any suggestions?
elasticsearch
asked Sep 18 '18 at 9:00
omriomri
234115
bumped to the homepage by Community♦ 16 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
Let's say i have an Index and I am want to create a daily index with an aliases.
Then I have some application that works against the elastic search(Mostly adding new documents to the index) and I am using Kibana to view and query against it.
So option number one for me is to have some separate Job which will run daily and create the index with its mapping and daily aliases. My problem here is that now my application is dependent on some outside job.
Option number two is before every insert to the ElasticSearch to check whether the Index exists(and if the mappings are current) and if not - to create it. Which seems to me worst then option 1 because of the overhead.
Any suggestions?
elasticsearch
asked Sep 18 '18 at 9:00
omriomri
234115
Let's say i have an Index and I am want to create a daily index with an aliases.
Then I have some application that works against the elastic search(Mostly adding new documents to the index) and I am using Kibana to view and query against it.
So option number one for me is to have some separate Job which will run daily and create the index with its mapping and daily aliases. My problem here is that now my application is dependent on some outside job.
Option number two is before every insert to the ElasticSearch to check whether the Index exists(and if the mappings are current) and if not - to create it. Which seems to me worst then option 1 because of the overhead.
Any suggestions?
elasticsearch
elasticsearch
asked Sep 18 '18 at 9:00
omriomri
234115
asked Sep 18 '18 at 9:00
omriomri
234115
asked Sep 18 '18 at 9:00
omriomri
234115
asked Sep 18 '18 at 9:00
omriomri
234115
asked Sep 18 '18 at 9:00
omriomri
234115
234115
bumped to the homepage by Community♦ 16 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
bumped to the homepage by Community♦ 16 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
You don't need to do anything special, as a new index will be created when you attempt to add a document to a non-existent index.
You may want to create an index template to ensure that the automatically created indices receive correct settings and mappings.
You will still need an outside scheduled process to delete indexes when their retention period expires.
answered Sep 18 '18 at 13:29
mustacciomustaccio
10.1k72239
but that's not a good approach in my view. For example the automated index created, added an "ignore_above" 256 chars as a default for every strting, what if i don't want that property. creating a template may be a good solution, i will look into that and update. thx!
– omri
Sep 20 '18 at 6:11
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "182"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdba.stackexchange.com%2fquestions%2f217885%2felasticsearch-daily-index-mapping%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
You don't need to do anything special, as a new index will be created when you attempt to add a document to a non-existent index.
You may want to create an index template to ensure that the automatically created indices receive correct settings and mappings.
You will still need an outside scheduled process to delete indexes when their retention period expires.
answered Sep 18 '18 at 13:29
mustacciomustaccio
10.1k72239
but that's not a good approach in my view. For example the automated index created, added an "ignore_above" 256 chars as a default for every strting, what if i don't want that property. creating a template may be a good solution, i will look into that and update. thx!
– omri
Sep 20 '18 at 6:11
add a comment |
You don't need to do anything special, as a new index will be created when you attempt to add a document to a non-existent index.
You may want to create an index template to ensure that the automatically created indices receive correct settings and mappings.
You will still need an outside scheduled process to delete indexes when their retention period expires.
answered Sep 18 '18 at 13:29
mustacciomustaccio
10.1k72239
but that's not a good approach in my view. For example the automated index created, added an "ignore_above" 256 chars as a default for every strting, what if i don't want that property. creating a template may be a good solution, i will look into that and update. thx!
– omri
Sep 20 '18 at 6:11
add a comment |
You don't need to do anything special, as a new index will be created when you attempt to add a document to a non-existent index.
You may want to create an index template to ensure that the automatically created indices receive correct settings and mappings.
You will still need an outside scheduled process to delete indexes when their retention period expires.
answered Sep 18 '18 at 13:29
mustacciomustaccio
10.1k72239
You don't need to do anything special, as a new index will be created when you attempt to add a document to a non-existent index.
You may want to create an index template to ensure that the automatically created indices receive correct settings and mappings.
You will still need an outside scheduled process to delete indexes when their retention period expires.
answered Sep 18 '18 at 13:29
mustacciomustaccio
10.1k72239
answered Sep 18 '18 at 13:29
mustacciomustaccio
10.1k72239
answered Sep 18 '18 at 13:29
mustacciomustaccio
10.1k72239
answered Sep 18 '18 at 13:29
mustacciomustaccio
10.1k72239
10.1k72239
but that's not a good approach in my view. For example the automated index created, added an "ignore_above" 256 chars as a default for every strting, what if i don't want that property. creating a template may be a good solution, i will look into that and update. thx!
– omri
Sep 20 '18 at 6:11
add a comment |
but that's not a good approach in my view. For example the automated index created, added an "ignore_above" 256 chars as a default for every strting, what if i don't want that property. creating a template may be a good solution, i will look into that and update. thx!
– omri
Sep 20 '18 at 6:11
but that's not a good approach in my view. For example the automated index created, added an "ignore_above" 256 chars as a default for every strting, what if i don't want that property. creating a template may be a good solution, i will look into that and update. thx!
– omri
Sep 20 '18 at 6:11
but that's not a good approach in my view. For example the automated index created, added an "ignore_above" 256 chars as a default for every strting, what if i don't want that property. creating a template may be a good solution, i will look into that and update. thx!
– omri
Sep 20 '18 at 6:11
add a comment |
Thanks for contributing an answer to Database Administrators Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdba.stackexchange.com%2fquestions%2f217885%2felasticsearch-daily-index-mapping%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
