Compare 500 files and load only distinct record Announcing the arrival of Valued Associate...
Check which numbers satisfy the condition [A*B*C = A! + B! + C!]
Is 1 ppb equal to 1 μg/kg?
I am not a queen, who am I?
Gastric acid as a weapon
What does the "x" in "x86" represent?
How to bypass password on Windows XP account?
Stars Make Stars
How do I keep my slimes from escaping their pens?
How do I stop a creek from eroding my steep embankment?
How can whole tone melodies sound more interesting?
Is there a concise way to say "all of the X, one of each"?
Why are there no cargo aircraft with "flying wing" design?
Is the Standard Deduction better than Itemized when both are the same amount?
If Jon Snow became King of the Seven Kingdoms what would his regnal number be?
What is a Meta algorithm?
What does '1 unit of lemon juice' mean in a grandma's drink recipe?
Antler Helmet: Can it work?
Is there a way in Ruby to make just any one out of many keyword arguments required?
When to stop saving and start investing?
How does cp -a work
How do I determine if the rules for a long jump or high jump are applicable for Monks?
What are the pros and cons of Aerospike nosecones?
Models of set theory where not every set can be linearly ordered
Are my PIs rude or am I just being too sensitive?
Compare 500 files and load only distinct record
Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)Doing a comparison on two csv files with no Primary Keywhy is io_stall_writes_ms so much higher for tempdb?Load infile query issue in mysqlHow to verify data dumps between two MS SQL and MySQLSELECT and UPDATE in a single query while updating selective fields of duplicate records onlyRetrieving only the last row of a table, in the absence of a primary keyFind max and min date over multiple fields of the same recordBest Practice : Schema design for Large Number of rows with few columnsRecover innodb mysql 5.6 database WITH ib_logfile0,ib_logfile1, and ibdata1 but WITHOUT .idb filesRestoring a WordPress site from WAMP with only .ibd and .frm files, into a new WAMP with … .myd and .myi files?
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ margin-bottom:0;
}
I have 400 to 600 different files and with same data type. But in these files, we have so many duplicates record in all the files.
In my folder, there are A.txt, b,txt, c.txt files are there.
It may be possible, that the values in c.txt is same copied in B.txt or values from B.txt is same copied to A.txt.
So, i need to compare the each row before loading the data into the data.
Column names are
Authorization_ID |DATE_AP| Ref_Eff_Date| Ref_Exp_Date| Major_Cost_Cat| Member_ID| Provider_ID_FA|.
We need to compare the values in cache by each txt file and if its distinct, then load the file.
sql-server mysql sql-server-2012 sql-server-2008
asked 9 mins ago
Avinash KumarAvinash Kumar
216
add a comment |
I have 400 to 600 different files and with same data type. But in these files, we have so many duplicates record in all the files.
In my folder, there are A.txt, b,txt, c.txt files are there.
It may be possible, that the values in c.txt is same copied in B.txt or values from B.txt is same copied to A.txt.
So, i need to compare the each row before loading the data into the data.
Column names are
Authorization_ID |DATE_AP| Ref_Eff_Date| Ref_Exp_Date| Major_Cost_Cat| Member_ID| Provider_ID_FA|.
We need to compare the values in cache by each txt file and if its distinct, then load the file.
sql-server mysql sql-server-2012 sql-server-2008
asked 9 mins ago
Avinash KumarAvinash Kumar
216
add a comment |
I have 400 to 600 different files and with same data type. But in these files, we have so many duplicates record in all the files.
In my folder, there are A.txt, b,txt, c.txt files are there.
It may be possible, that the values in c.txt is same copied in B.txt or values from B.txt is same copied to A.txt.
So, i need to compare the each row before loading the data into the data.
Column names are
Authorization_ID |DATE_AP| Ref_Eff_Date| Ref_Exp_Date| Major_Cost_Cat| Member_ID| Provider_ID_FA|.
We need to compare the values in cache by each txt file and if its distinct, then load the file.
sql-server mysql sql-server-2012 sql-server-2008
asked 9 mins ago
Avinash KumarAvinash Kumar
216
I have 400 to 600 different files and with same data type. But in these files, we have so many duplicates record in all the files.
In my folder, there are A.txt, b,txt, c.txt files are there.
It may be possible, that the values in c.txt is same copied in B.txt or values from B.txt is same copied to A.txt.
So, i need to compare the each row before loading the data into the data.
Column names are
Authorization_ID |DATE_AP| Ref_Eff_Date| Ref_Exp_Date| Major_Cost_Cat| Member_ID| Provider_ID_FA|.
We need to compare the values in cache by each txt file and if its distinct, then load the file.
sql-server mysql sql-server-2012 sql-server-2008
sql-server mysql sql-server-2012 sql-server-2008
asked 9 mins ago
Avinash KumarAvinash Kumar
216
asked 9 mins ago
Avinash KumarAvinash Kumar
216
asked 9 mins ago
Avinash KumarAvinash Kumar
216
asked 9 mins ago
Avinash KumarAvinash Kumar
216
asked 9 mins ago
Avinash KumarAvinash Kumar
216
216
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "182"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdba.stackexchange.com%2fquestions%2f234856%2fcompare-500-files-and-load-only-distinct-record%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Database Administrators Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdba.stackexchange.com%2fquestions%2f234856%2fcompare-500-files-and-load-only-distinct-record%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
