How To use Google Correlate for data mining , data patterns, trends

Lets look at Snow news pattern over time.
Normal data:
You can clearly see around End of Each year snow news peak Which is right.. That’s how it should be as winter season comes around December everywhere..

https://www.google.com/trends/correlate/search?e=snow&t=weekly&p=us

But abnormal pattern is the number of peaks news making Each year.
As Every time it snows at any part of world people searches increase giving consolidated data pattern. One more worry look is the Elongation of top curve and variation there it getting more varried Every year since 2004.
SnowNewsPattern

Look at this trend of popularity of functional languages.

Trends of popularity of Functional langauages

Trends of popularity of Functional langauages

Next generation Application development

The Next generation application development will not only take care of utilizing 50 or 100+ processors which will be available in you laptop or desktop or mobile but by using parallel processing available at clients
https://sandyclassic.wordpress.com/2012/11/11/parallel-programming-take-advantage-of-multi-core-processors-using-parallel-studio/
I covered 7 points last article this is part -2 of
https://sandyclassic.wordpress.com/2013/09/18/new-breed-of-app-development-is-here/
also Next genration ERP read first: https://sandyclassic.wordpress.com/2013/09/16/new-age-enterprise-resource-planning-systems/
8. More pervasive BI eating App: Business Intelligence application development will go deeper in organisation Hierarchy
Oraganisation Hirearchyfrom more strategic level BI  and Middle management level to more pervasive  transactional processing level , and Office automation System level BI (shown in diagram as knowledge level or operational level.)

How it will affect architecture of Enterprise product Read SAP HANA
https://sandyclassic.wordpress.com/2011/11/04/architecture-and-sap-hana-vs-oracle-exadata-competitive-analysis/
Understanding Management aspect to little contrary view but related.. there will be need for more deeper strategic Information system to make more unstructured decision making.
https://sandyclassic.wordpress.com/2013/01/31/strategic-information-systems-will-be-in-focus-again-next-5-yrs/

pervasive BI bound to eat up Application development market also fulled by in-memory products like cognos TM1, SAP HANA etc..but also changes, cross functional innovation happening at enterprise level.
read :https://sandyclassic.wordpress.com/2013/09/18/new-breed-of-app-development-is-here/

As with these products no need for separate Database for datawarehouse and for operational systems. This unification of Operational data store ODS and data warehouse DW. on reporting level both Business intelligence BI and operational reporting will be accessing same database and that will be using in Memory technology.

9. Bigdata as everyone knows is Hot: more unstructured data than structured data today present for you is like open laboratory to experiment. More of it will find place in strategic management system and Management Information system.
read more details: https://sandyclassic.wordpress.com/2013/06/18/bigdatacloud-business-intelligence-and-analytics/

Read Application in security for metadata analysis : https://sandyclassic.wordpress.com/2013/06/18/how-to-maintain-privacy-with-surveillance/

10. Application security will be important as never before: its already there .
The intensity can be gauged from fact that changes in top 10 OWASP list is happening as never before and positions are changing in terms of top most risk ranking.
https://www.owasp.org/index.php/Top_10_2013-Top_10

list before:

https://www.owasp.org/index.php/Top_10_2010-Main

2010 A2 was Cross site Scripting XSS but 2013 at ranking to of perceived risk is Broken Authentication and session management. Changes do happen but here ranking and no of incident changing fast because momentum is fast.
11. More will continue when I find time next time….

Problem with Plagiarism software (more English test less science innovation test)

If you paraphrase then you are innovative. I cannot understand is it scientific innovation which is tested or English language test.
I want to keep other work as original and my work separately there that would be real scientific innovation
We are not writing novels here by paraphrasing…
Its not that i cannot paraphrase I can do better but I feel is n’t it real waste of money by paraphrasing worlds and saying that is your original work…
There should be some numbering system to qualify using categorisation using market basket, using machine learning algorithm and compare, RDF or ontology or owl.. there would be many method of categorisation which is used currently. Some of this would be surely used but there are still gaps. how can paraphrase pass test?

Gini coefficient of economics and ROC curve machine learning

Receiver Operator curve or ROC curve are used in data mining , machine learning. from area under ROC curve u can calculate Gini coefficient. I have made an excel template

2013-05-12 18.58.03

Example to show how its calculated.

if AUC is area under curve then,

G= 2AUC-1

Gini coefficient the most watched coefficient of economics these days :
I wrote a article comparing different countries of world with data available

https://sandyclassic.wordpress.com/2013/02/06/watch-gini-coefficient-only-show-income-distribution-not-lowhigh-income-distribution/

Gini coefficient AUC has some component of noise which called to question of better measures which are used in machine learning DeltP or informedness ,mattews correlation coefficient each one is suitable to its own field while informedness=1 shows perfect performance while -1 represent perverse of negative performance despite all informedness. Economics Gini zero shows perfect equality.

So parameters keep improving there is no end result and there cannot be as our understanding increases we come at better measures and change is constant..but what is truth today was mystery or magic for old and would be kind of half truth for future..But the subjects are interconnected the branching of knowledge areas is going on since last 250 yrs.. earlier there was no engineering everything was under philosophy during Socrates. Socrates rightly said : that you cannot say anything with absolute certainty. But you can have informed decision that is what informedness quantifies that your decision how much they are informed decisions.

See a case from Biometrics:

submitAssign1