Architecture sap hana vs oracle exadata competitive analysis part -2

READ part 1:
https://sandyclassic.wordpress.com/2011/11/04/architecture-and-sap-hana-vs-oracle-exadata-competitive-analysis/
This debate of SAP Vs Oracle or last 2 yrs buzz SAP HANA vs Oracle Exalytics
Every year in Enterprise Software space Competition of SAP Vs Oracle Hots up with new announcements and New technology comparisons of SAP new Tech Vs Oracle New Tech.
The Enterprise Software stack built up by No.1 and No.2  world’s top most valued companies in Enterprise Technology Space.
So SAP Vs Oracle comparison will never go out of picture only every year it will up the ante. 
In Memory Technology: SAP Vs Oracle (New tech now 2 yrs old).

Now a day In-Memory Technology is the Hottest area especially in Business Intelligence (BI). But its not limited to BI it goes into ERP, Application development of any Kind.
The processing infrastructure in form of in Memory Systems is much faster than any other form. As Cost of RAM is coming down and capacity of server is expanding So most data to be processed can be pulled inside memory at once instead of using Locality of reference to pull and process from secondary memory.
Also Server can hold lot more data to processed in memory at once.
SAP HANA Vs Oracle Exadata
So SAP Came with SAP HANA and Oracle has its own in memory systems. At same time Oracle released high performance machine Exadata which brook many performance records. So There was running comparisons of SAP Vs Oracle in Enterprise Technology space.
innovation at SAP : ABAP, BSP and BAPI 
SAP customized by using  Advanced Business Application Programming (ABAP) Language.
Using which reports are customized, forms are modified, business processes are written to reflect business Logic. ILE, BAPI, IDOC can be used to interface with external software or integration or developing Adaptor. Custom Exits and User Exits are written to customize forms and reports.
For SAP datawarehouse technology SAP BIW or SAP BI datawarehouse is created using
Extraction Legacy System Migration Workbench (LSMW) or Cost and profitability Analysis (COPA) Extrations then transformation can be applied using ABAP user exits.
Problem with ABAP is compared to mordern langauges it has not evolved much over time.
Most of ABAP constructs are similar to COBOL constructs. There is Object oriented ABAP also like JSP or ASP  it came up with BSP (Business Server Pages) to Expose ABAP code directly to Web like JSP does for Java or ASP does for Microsoft Technology.

SAP Netweaver  Vs SAP ABAP BSP
SAP began adopting Java in 2003 and came up with Netweaver product which was J2EE server for ABAP code. Now you can code using either java or ABAP in netweaver. For Application requiring functionality to exposed to Web Java was natural choice.
But Oracle having acquired Java in year 2010 Since then there was continuous Effort on part of SAP to move away from its dependence of Java.  So BSP came into picture as first step.
Benefits of In-memory in SAP HANA
next was paradigm shift using Columar database instead of Row oriented databases which consumed less storage (on account of reduction in repetitions of similar column values as well compression of data).
Also it integrates:
BI and datawarehousing system or OLAP with
Operational systems or OLTP Systems as one.
Even Analytic requiring lowest level of granularity can be queried on same server.
Effect of which was Whole data can be pulled and kept in In-memory system offering faster response time to multiple user connected at same time rather than
Regular database Query processing logic
parsing request , making parse tree,
comparing with already fetched query parse tree in cache
if not available
then
fetching data from secondary memory
when depending on the request into

Improvement in data processing in SAP HANA and column oriented database
Now since whole data can be kept in-memory So Every query can directly fetch data quicker.
Future Technology Like SAP HANA
Enhancement over this Technology are Probabilistic databases and Graph databases.
Graph databases are available commercially since long time.
Index free storage. Every element has direct pointer to adjacent element, hence no lookup needed.
Here is list:
http://en.wikipedia.org/wiki/Graph_database
And
Probabilistic databases : Are active area of research as discussed above as well.
http://en.wikipedia.org/wiki/Probabilistic_database

A day in life of Peoplesoft Functional Consultant part 1

Depending on ERP there can be many modules inside..
Major modules of peoplesoft ERP are :
1. Human Resource Management Systems HRMS
Submodules: (payroll, Core HR, benefits, recruitment, performance management)
2. Financials
(Account payable AP, Account Receivable AR, General Ledger GL etc..)
3. Supply chain Management SCM
4. Customer Relationship Management CRM

Functional consultant major work is during GAP Analysis To find As-IS state and identify work required to achieve TO-BE state.
Find all those forms which needs to be modified, and all those reports which needs to be modified And Exactly what field to change, What button to remove, What functionality to be disabled, What pre-delivered business logic behind components to be modified and What formulae to be used during modification.
There is Another Module which is consider Techno-functional Peopesoft EPM. EPM is datawarehouse part which has four major components for Each of four above there is a data mart for each area of finance, HR, SCM, CRM.
Each contains data from its own module transferred using ETL tools and reporting using BI Tools and analytics can be applied over formulae in BI systems.
-Also functional consultant decide based on feedback from local management to modify field like in HRMS a rejoining of employee should get ID as previous from old record or new ID based of policy in management.
if Payroll of local market like irish payroll or indian payroll does not exits then it should existing global payroll should be modified to achieve local labour laws and saving rules , income tax based customisation.

A day in life of peoplesoft Technical Consultant part 1

There are 5 major streams for Peoplesoft technical consultant
1. Reporting Tool:  Hyperion SQR, nvision, Crystal,
2. Server Tool: peopesoft internet Architecture, Tuxedo, JOLT, Webserver, Appserver
3. Application development: peoplecode, application designer, App Engine, PS integration Broker,
4. Installation and Upgrade : Upgrade Assistant,
5. Peoplesoft DBA: all issues related to Database on top of which peoplesoft ERP is sitting.

Depending of Each of these streams The a day in life of Peoplesoft technical consultant will differ.
Life cycle of Peoplesoft implementation from :
4 major areas:
1. GAP Analysis,
2. implementation,
3. stabilization phase of ERP ,
4. and support for already developed

Each phase has its own daily routine Like during support phase
3 major type of request which can come from user is ICE:
Incident, Customization, and Enhancement request.

During gap analysis: The As-IS state is studied and its difference made out from TO-BE state. The Gap between AS-IS and TO-BE state is implementation which needs to done.
As you know peoplesoft is ERP package comes with its pre-delivered tables, forms and reports Which needs customisation depending on company, country , laws of land, company processes.

During implementations phase according to gap analysed forms , reports are customized using peoplecode language and application designer, 9 steps process is applied to each component being developed, which include security settings.
SQR banned reports are being customized with header footer for display and for business logic of processing data fetched from database and displaying in format required using option like BREAK options.

Support Phase ICE request for each change is being accepted for Incident, enhancement and Customisation for Each Change Request raised and Accepted or any errors in existing code.

Design Pattern In Real World- part 1

Phases of Business Software applications development:
1. Mainframe COBOL
2. Internet driven Client Server based Language Java/J2EE,.NET
3. ERP: interconnected Module pre-delivered domain based Forms/Reports allowing customisation.
4.  Integrated systems, Mobile, Bigdata and on Cloud platform.
———————————————————————
Interoperability : Bridge or Adapter Design pattern.
Integrated System seamless Coarse-grain integration offered by Web services. Having Restful web services implied SOAP can travel over as http request.
Web services based integration meant less use of COM/DCOM or CORBA.
The inter-operability brought by Web services Also meant Enterprise Application Integration vendors like Web methods and Tibco also employed Web services in Genral.
EAI Tools moved Data Across ERP from Poeplesoft HRMS payroll to SAP Financials General Ledger GL. Thus Forming Like Bridge or Adapter integration pattern.
The EAI Tool having maximum adapters had Edge.To Some Extent Web services based coarse grain integration Changed This a lot.
Every ERP also created its own EAI version like SAP XI/PI, Peopesoft integration broker,Oracle applications had Oracle Fusion Middle ware.
And Some times Back Buzzword was in Oracle : Oracle ERP would be Fusion based.
And Web services engulfed Service Oriented Architecture SOA started entering into Business applications and New Product Architecture.Hence ESB Enterprise service Bus (ESB) Controlling Those coarse grain services are abundant in market.
SOA was buzzword  in 2008 at peak it existed before as well. New Architecture modifications started emerging Like SCA. SCA is also not new atleast 5 yrs there traction i this area.
Look at http://tuscany.apache.org/sca-java-architecture-guide.html
There Changes more affect Server side Coding.
What is There at client Side with AJAX components interacting with SOA in server side.
From Web 2.0 now we are in Web 3.0 and 4.0 started emerging with had effect on both server and client side code with semantic web but more focused on user Ease.
Ajax design pattern started emerging 2005 onwards. As more code started shifting towards Client side in form on AJAX, json, DWR  web remoting languages like Dojo started to play better co-ordinations.
Look at http://directwebremoting.org/dwr/introduction/elsewhere.html
The Flash modified its code base to provide Flex in Action script you get neatly made components configurable by Action script interacting with Web services using Blaze-Ds providing RIA Rich internet Applications.

Every language has Framework
The Languages moved more into framework solving applications issues by employing Struts/Spring. From more program driven towards more declarative languages where properties are defined in XML and based on that Code is configured.
As Framework Solved issue like validation using Struts or Dependency injection in flow of code or using Annotations in Spring. The languages also matured to bring features like annotations in latest Java release. C++ templates entered into Java. And Generics made Entry. From Declarative programming to Dynamic Programming.
The Spring Came with inversion of Control I0C which took callback concept to a new height and as discussed dependency injections.
iphone has Cocoa framework, Php has zend , Java had Structs, hibernate (ORM) and Spring.

Language Entering New Areas:
Language continue to Enter in new areas Like data mining Java data mining API, .net data mining API, like image processing API or 2d/3d graphics API. Language integrating with Phone services using Session Initiation protocol SIP which make digital phone hence Skype call to phone a reality.
Language became better organized with unit testing framework like java junit, .Net nUnit.
kind of project management using maven.

Design Pattern:
Gang Of Four pattern: Structural, decorative, behavioural design pattern etc..
Enterprise design Pattern like one given by martin flower generalises the popular product /service offering behaviours.
The Known Unknown factor has reduced. What is still not captured is Unknown Unknown?
How to drive into knowledge like conceptualized by semantic Web or Ontology?
Can Algorithm behave like pattern ? What I mean Can it be Generalized?
Only thing possible to Algorithm is Space and Time Complexity Analysis The BigO.
Can we treat Unknown Unknown area charted by Algorithms into sort of categorisation?

Open Source program driven file based Real time databases:
Now There is requirement and maturity for program driven real time Database and platform Like using used by social networking products RealTime databases like Cassandra by facebook, Amazon’s Dynamo,

Mathematical Modelling the Sensor Network

 

Modelling Wireless sensor network

Modelling Wireless sensor network

1. Go through the Slides about Modelling the Wireless sensor Network and Internet of Things

  • 10 PROJECT GOALS 1. Routing algorithm: SPIN,CTP. 2. measure energy consumed 3. Validate PPECEM Model 4. Improve in existing model for efficiency, reliability, availability.
  • 2. 10 PROJECT GOALS 5. New Model: ERAECEM Efficiency Reliability Availability Energy consumption Estimation Model. 6. ERAQP BASED on ERAECEM Model for WSN a new energy aware routing algorithm (ERAQP)
  • 3. 10 PROJECT GOALS 7. Configurable Routing Algorithm Approach Proposed on WSN motes utilizing user defined QoS parameters 8. Model for WSN: Leader-Follower Model, Directed Diffusion Model
  • 4. 10 PROJECT GOALS 9. Fuzzy routing Algorithm 10. Fuzzy Information Neural Network representation of Wireless Sensor Network.
  • 5. MOTIVATION
  • 6. 1.1 SPIN
  • 7. 1.2 CTP  Collection tree protocol
  • 8. 2 ENERGY MEASUREMENT  Agilent 33522B Waveform Generator was used to measure the Current and voltage graph .  The Graph measurement were then converted to numerical power Power= Voltage X current = V X I. The Power consumed during motes routing on SPIN and CTP then taken into is added up to give power consumption and values are applied to PPECEM.
  • 9. 1.3 WSN SECURITY
  • 10. 3.1COST OF SECURITY  Cost of security In WSN can only be estimated by looking at extra burden of secure algorithm and security of Energy Consumption as the Energy is key driver or critical resource in design of WSN. As design is completely dominated by size of battery supplying power to mote.
  • 11. 3.2 PPECEM  QCPU = PCPU * TCPU = PCPU * (BEnc * TBEnc + BDec * TBDec +BMac * TBMac + TRadioActive) Eq.2)
  • 12. 4 ERA  Efficiency = Ptr X Prc X Pcry … (Eq.2)  Reliability = Rnode1 = FtrX FrcX Fcy  Availability= TFNode1 = Ftr+ Frc+Fcry
  • 13. 5. IMPROVE EXISTING  . ERA = fed  Efficiency of Energy Model: QEff=QCPU X Eff (improvement #1 in Zang model)
  • 14. ERAECEM  Etotal = Average(Eff + R +A)= (E+R+A)/3  Efficiency of Energy Model: QEff=QCPU X Etotal (improvement #1 in Zang model)
  • 15. 6 ERAQP  Efficiency ,Reliability, Availability QoS prioritized routing Algorithm  ERA ranked and routing based Ranking Cost on Dijesktra to find most suitable path
  • 16. 7.CONFIG. ROUTING  q1, q2, q3 as QoS parameter algorithm rank Motes/nodes based on combined score of these parameters. Based on this we rank we apply Dijesktra algorithm to arrive at least path or elect Cluster head to node. Thus q1, q2, q3 can be added, deleted.
  • 17. 8 MATHEMATICAL MODEL  Leader Follower EACH node share defined diffusion rate given by slider control on UI which tells quantity it is diffusing with its neighbors.Since it’s a directed graph so Node B gives data towards Node A while traffic from A towards B may be non-existent  Directed Diffusion Mathematical model represent diffusion of quantity towards a directed network. Helps to understand topology, density and stability of network and a starting point for designing complex , realistic Network Model.
  • 18. 9 FUZZY ROUTING  Fuzzy set A {MoteA, p(A))  Where, p(A) is probability Of Data Usage Or Percentage Load in Fraction Compared With Global Load
  • 19. 10 FUZZY TOPOLOGY  Based on this Utilization p(A) nodes can be ranked in ascending order to find most data dwarfed node at the top. Then We can apply Dijkstra’s algorithm on the network to find best route based on weight on each node represented by Rank.

2. WSN and BPEL and Internet Of Things (IoT)
https://sandyclassic.wordpress.com/2013/10/06/bpm-bpel-and-internet-of-things/

3. Internet Of Things (IoT) and effects on other device ecosystem.
The Changing Landscape:
https://sandyclassic.wordpress.com/2013/10/01/internet-of-things/

4. How application development changes with IoT, Bigdata, parallel computing, HPC High performance computing.
https://sandyclassic.wordpress.com/2013/09/18/new-breed-of-app-development-is-here/

 

Retail sector Innovations ,economics and Software

Retail sector has redefined they way goods are sold to customer. Sociology helps to decide where society is moving thus what possible product can be made for changing society preferences. Marketing just present those choices to potential customers. Sociology does play a front End to marketing. As be see behavioural Economics coming to for front to vindicate these facts last 2 decades.
Software innovation in Retail : from Retail Inventory planning software tracking inventory, to sensor and tags tracking goods through RFID, Retail non tactical , non structured management planning BI systems using SAP BO, IBM Cognos, Microstrategy BI, SQL server SSRS BI. look Manathan BI (www.manthansystems.com/) which is based on SSRS. Read details big data, retail andRFID:
https://sandyclassic.wordpress.com/2011/10/26/big-data-and-data-integration/

Read How Software is Eating Retail: 
https://sandyclassic.wordpress.com/2011/10/30/groupon-on-top-5-along-with-facebooklinkedin-can-rediff-deals-do-the-same-in-india/

As Philip Kotler defined 5C and 5P of marketing. 5P (product, promotion, place, price,People) and 5 C being (Custmer, Company, collaborator, competition, context)
Read future trends: http://www.kotlermarketing.com/phil_questions.shtml
Read Book :
MarketingKotlerhttp://www.amazon.com/Marketing-Management-Philip-Kotler/dp/0130336297
In Retail sector out of 5P (Place) is very important centrally located , easy accessible to potential customers place can act as magnet for pulling in customers to mall. Then (Promotion) free car parking ,cleaning, or less than cost ice cream at Mac Donald s to attract consumers. (Price) This is where Wall mart is very famous for keeping prices low by attracting many sellers on same floor competing with each other thus like perfect competition condition goods are sold almost at price of Cost of production and supply chain are kept at level of minimal inventory to keep cost down. Supply Chain side automations brings down cost as well more rotation of goods.
Like how P&G and Nestle maintain there Physical warehouses see products by this company
you can register a see complete movie how its done.
http://warehouseoptimization.com/
Like maintaining Go-down with efficient warehousing management and quick reordering based alert issued by sensor on shelf following the (Reorder-level). Thus one of the Cost leadership strategy given by peter Ducker.
just Read few thoughts by author:
http://www.goodreads.com/author/quotes/12008.Peter_F_Drucker
Book:Drucker Management
http://www.amazon.com/The-Essential-Drucker-Management-Essentials/dp/0061345016
T
here was a classic case : On Grass cutting company On account of being marginalized in perfect competition floor of  thus not able to achieve set price to by providing differentiated product said No to walmart
Read : Man who said No to Walmart
http://www.fastcompany.com/54763/man-who-said-no-wal-mart
Retail moved a long was towards innovation last 2 decade from merchandising by experts and procurement experts dealing with suppliers always thinking about the assortment they need to present to customer entering the Mall. Tracking Eyeball of consumer picking up consumer behaviour to schedule the products related to each other in one shelf or in nearby place. Creating products variety is assortment planned so as to achieve variety and meeting matrix of operational efficiency of (price, quality, time  flexibility).
Any shopping mall place with promotion pulls up potential customer called prospect to store area. Then Each vendor has its strategy of luring in customer because once in the store and customer start spending then customer does not think much about cost also like mac Donald less cost ice cream example other Items does get ordered out of expected value a consumer may derive. The rational choice theory does also play important role. It has been Noble prize winning theory by prof Daniel Kahneman (2002) and Gary Becker (1992).  Read : http://en.wikipedia.org/wiki/Rational_choice_theory
Consumer Behaviour is getting shaped by the behavioural Economics of Rationality which is inherent in our thinking process.
Not only does it help justify Stock behaviour it does tell consumer preferences after entering into store.
From the format of stores and their strategies
1. Retail Store: Super Store, department store , Hypermarts, discount store,
Read Strategy here : http://en.wikipedia.org/wiki/Retail#Types_of_retail_outlets

2. Wholesale stores/Warehouse Club : for small vendor taking bulk orders at once. Like metro  http://en.wikipedia.org/wiki/Warehouse_club
These differentiation help to achieve variety and specialization and hence more premium is available in terms of not cost but volume.
Its like classical economics “Supply will create its own demand” Although its not much relevant but surely its in play say (10%) of cases. Because there are other factors as well which dominate its not sellers market its buyers market.

Generalize problem solving through design pattern

When we start solving a problem: first step to to get logic so we can program it.
Like is some where repetition which happens so we can put in loop or we can repeat data structures like stack and array.
Data Structure to generalize 
Then we take storage about which data structure to Use let us suppose we are building a program whose maximum capacity to store a number is 10^12 but we want to add
10^12 +  10 ^12 how to achieve this when max capacity is 10^12?
Then we have to use storage through data structure like Stack…
We can create 2 stacks of each number with digit arranged in LIFO.
How will we add: take simple example : we take two 3 digit numbers
123 + 456
Stack 1             Stack 2
1              |        4                                                                                                                                    2              |        5                                                                                                                                     3              |        6
————————- We can not add these no by poping() stack pointer at top
and multiplying with its position in Stack 1: Like 123= 3 X 1+2 X 10+1 X 100.
and                                                        Stack2:         456=6 X 1+ 5 X10 +6 X 100.
=——————————————————————————                      So We pop  out 1 from (Stack 1) and 6 from (Stack 2) and Add take any carry to next element of stack. We can use array we can create linked list of Equation or we can use Stack (since number are added in LIFO from left to right) Stack are best match.
As we can see How the above is added:
pop unit position from stack 1 + pop unit position from stack 2 = store in stack 3 unit position
Stack 1             Stack 2        =  StackSum
3              |        6              =      9                                                                                                            2              |        5               =      7                                                                                                        1              |        4               =     5                                                                                                            Now Stacksum will contain Numbers in sequence push(9), push(7),push(5).

But Stack pops out in LIFO so Last inserted pop(9) X 1 + pop(7) X 10 + pop(5) X 100=579.
This example used only 3 digit but actually limits of System We can Enhance using data Structure like here..
——————————————————————————————
There can be multiple practical example for menus liked through Linked List or 2 Phase commit is Oracle Using Queue of multiple user request at multiple server.  We can fit in structure based on requirement. (Lowest level of generalisation)
—————————————————————————————

More higher level (top level) from 100 feet above earth we are now coming to 1000 feet We move towards Algorithms to decide which we have used one above.. but
We analyse 2 complexity .. time complexity and space complexity suing popular BigO notation to analyse performance of Algorithm.  This performance evaluation is also generalized using BigO and using popular Algorithms..
Like we want to see segmentation of market but we do not know what are different possibility of Buckets or segments.
Then We use like popular Market Basket Algorithm….
————————————————————————————–

10,000 feet level generalisation: Design Pattern ..

In GoF (Gang of four pattern) we have There are 3 category of design pattern Behavioural, Structural and creational
more read:http://en.wikipedia.org/wiki/Design_Patterns                                                   more general read:http://en.wikipedia.org/wiki/Software_design_pattern

Example:
So We see every time we create a web site we need user login, we need to maintain session hence session level objects,
So in Design pattern We search What pattern matches this design requirements Like (Visitor pattern) fits in here.
Integration Design pattern———————————————————-
Or In general during Integration we use Bridge pattern or Adapter pattern which is used in most integration tools like Webmethods (www.webmethods.com) and TIBCO (www.tibco.com)
We have many Integration design patterns only for integration….
http://en.wikipedia.org/wiki/Enterprise_Integration_Patterns
Nowadays We have more course grain integration using Web services.
With Everything Exposed as web service is interoperable across programming languages like Java and .net and with data in XML we have data portability.
This strategy is used in like enterprise service bus or in design of many BI / BPM tools read:
https://sandyclassic.wordpress.com/2013/10/05/enterprise-service-bus-esb-bpm-orchestration-and-process-re-engineering/
————————————————————————————–
20,000 feet level generalisation: Enterprise Design pattern
Depending on requirement we will mix and match.
There are various design pattern which exist today there are thousands of algorithm which can be chosen inside each mixture of pattern chosen
Let suppose we want to mix data set of two server session user information pattern in used in Observer pattern + Merge Sort (list) and create new list.. and sink in unified database.

Read this Discussion: http://www.sitepoint.com/understanding-the-observer-pattern/

There are at Tool or development level Frameworks which exist to create already known programming structure Like Spring Framework uses Aspect Oriented Programing,
Declarative programming style is generalized with annotation @web service making a POJO exposed as Web service… Then we need to think we want restful web serices

BPM, BPEL and Internet of things

Most initial components of Internet of Things comes from wireless sensor networks.
Internet of Things using TinyOS platform : http://onlinelibrary.wiley.com/doi/10.1002/dac.2444/abstract
Then it has to Ubiquitous
Read for more detail:
Internet of things: https://sandyclassic.wordpress.com/2013/10/01/internet-of-things/
more details search on blog https://sandyclassic.wordpress.com
Ubiquitous computing and BI
https://sandyclassic.wordpress.com/2012/10/28/ubiquity-the-most-crucial-challenge-in-business-intelligence/
Ubiquitous computing  and ERP:
https://sandyclassic.wordpress.com/2013/09/16/new-age-enterprise-resource-planning-systems/
——————————————————————————————-
BPM and BPEL helps in aligning changing business process requirements. Any creating orchestrating business processes. creating workflow , business Rules and process Engine.
typical BPM components architecture looks like this:
BPM_Workflow_Service_Patternmore details: http://en.wikipedia.org/wiki/Business_process_management
When multiple devices interact the processes between them have to be orchestrated , easiest and best way to created interaction between devices and create rules is by creating workflow. Also workflow is What you see is What you Get (WYSIWYG). A Naive user can also diagrammatically drag and drop workflow components available in the panel and set rules. Which are quite similar to Business Rules. So Even BPM will become pervasive with internet of things.
Also programming multiple device interaction for complex task. the complexity can be reduced for programmer by using BPM using notation available in BPMN.
Read: http://en.wikipedia.org/wiki/Business_Process_Model_and_Notation
BPMN-CollectVotesA typical workflow of voting process depicted above:
Now similarly device workflow are captured and programmed using BPMN notation.
Recently IBM released Node.js pattern JavaScript for Internet of things over wireless sensor networks.
node-red-screenshotRead more detail: http://gigaom.com/2013/09/27/meet-node-red-an-ibm-project-that-fulfills-the-internet-of-things-missing-link/
you can clearly see device workflow above . Also this is how we set the filter rules to analyse filter data from the web using yahoo pipes http://pipes.yahoo.com/pipes/
More details later sometime again: Happy reading 🙂

Architecture Difference between SAP Business Objects and IBM Cognos part1

Lets understand how Cognos product works internally

Most of BI product Architecture are almost similar internally.
BI Bus: Enterprise service Bus which surrounds all the services/servers which tool provide.
Typical ESB from Oracle BEA Aqualogic Stack engulfing many Web services looks like:
ESB_archNow you can compare this popular ESB with BI internal Architecture.
you can read more about ESB at : http://docs.oracle.com/cd/E13171_01/alsb/docs20/concepts/overview.html
Under 4 tier system: A client connects the Web server  (which is protected by firewall) using dispatcher. Dispatcher connects to Enterprise Service Bus (ESB) which surrounds all the application server services (Web services). ESB in case of cognos is Cognos BI Bus surrounds Web services Servers (like Report Server, Job server, Content Management server etc ). Mediation Layer Cognos BI Bus interacts with Non Java , C++ code which could not to converted or purposefully kept in C++ for may be more flexibility and speed
Cognos BI Bushttp://pic.dhe.ibm.com/infocenter/cbi/v10r1m1/index.jsp?topic=%2Fcom.ibm.swg.ba.cognos.crn_arch.10.1.1.doc%2Fc_arch_themulti-tierarchitecture.html

In case of SAP Business Objects (BO) ESB was not properly developed so an intermediate layer was created which works for interfacing between multiple servers like Job server, report server, page server etc. BO XI R2 came in pervius version was more in C++ to C++ to java bridge was created in ESB layer. Since Java was preferred language for coarse grain interoperability  provided by web services. Each server was developed using web services.
interaction between web server was routed through BI Bus.
BO-xi-r3.1-infrastructureIn latest version here u find a pipe connecting all components call Business Objects XI 3.1 Enterprise Infrastructure. Earlier version had different names. here you can see its connecting all server like Crystal report server, IFRS input file repository server( storing template of reports), OFRS Output file repository services, Program Job server(storing all programs which can be published on Portal (Infoview) ). This ESB does mediation between different server and achieves interoperability yet control of different components of products. This is in competitor product Cognos is called Cognos BI Bus.
http://bobi.blog.com/2013/06/02/sap-business-object-architecture-overview-and-comparatice-analysis/
For latest BO uses in memory product SAP HANA more about its competitors follow:
https://sandyclassic.wordpress.com/2011/11/04/architecture-and-sap-hana-vs-oracle-exadata-competitive-analysis/

In Micro-strategy there are two important server Intelligent server which creates cubes

More I will cover in later issues:
Oracle BI Architecture:
http://www.rittmanmead.com/2008/02/towards-a-future-oracle-bi-architecture/

Implementation OF BI system is not related to these product Architecture :
A  typical BI system under implementation haveing componets of ETL, BI, databases, Web server, app server, production server, test/development server looks like:
typical BI ArchtectureMore details: http://www.ibm.com/developerworks/patterns/bi/product-s390-web.html
Big Data Architecture:
From components perspective of ETL to BI implementation Aspect is little different
bigdata-scalein-architecture

Hadoop Architecture layers:
hadoop-architecturehttps://sandyclassic.wordpress.com/2011/10/19/hadoop-its-relation-to-new-architecture-enterprise-datawarehouse/
http://codemphasis.wordpress.com/2012/08/13/big-data-parallelism-and-hadoopbasics/

Just like UDDI registry is repository of Web

Internet of things New Paradigm Shift in Computing

Paradigm shift in Computing Industry over period of time:

Mainframe–> Personal Computer, (PC based Application software ) –> Web Computing (Web servers, Internet, web application) –> devices (Mobile/ Mobility )/IP TV , notebook /ipad —>
For next shift there lot of possibility Like surface computing might eliminate Screen requirement or Ipad/laptop requirement, IP TV interacting with human interactions with gesture to camera , and devices projecting screen on any surface. Many devices which are coming in the industry would certainly require Ubiquitous Access. And All devices will have agent to take informed decisions (Like once fridge know milk is empty it could connect to internet and ask your access to credit card or confirmation (workflow software configured) it can order retailer.(So like Internet of Things)
So Internet of things is not only these devices that will interact with other home system, devices but also get data with wired or wireless sensors inside Home.
more about it can be read at : https://sandyclassic.wordpress.com/2013/05/03/classifying-ubiquitious-data-images-into-emotion-for-target-advertisement-campaign/

Read: https://sandyclassic.wordpress.com/2012/10/28/ubiquity-the-most-crucial-challenge-in-business-intelligence/

New age application development :
https://sandyclassic.wordpress.com/2013/09/18/new-breed-of-app-development-is-here/

CMS are integrated with SIP servers for PSTN phone to Digital phone and Softphone conversion. More details:
https://sandyclassic.wordpress.com/2013/09/22/approach-to-best-collaboration-management-system/

All these will increase focus on the development Internet of Things with sensor network generating huge video,audio, image and text data collected from sensor has to move ubiquitous from one system to another. For this to happen internet infrastructure will be utilized using cluster computing of Hadoop, Hive, HBase. for data analysis and storage. When sensor nodes , devices , Home appliances access and interact with this data ubiquitously  at same time interact , under transaction using internet infrastructure Possibility of Internet of things is only conclusion it can derive.
Read more on hadoop: https://sandyclassic.wordpress.com/2011/10/19/hadoop-its-relation-to-new-architecture-enterprise-datawarehouse/

Relation to cloud here 3V have actually now became 5V variability and value new 2V +addition to existing 3V Volume, variety and velocity being old 3V.                                  Read more: https://sandyclassic.wordpress.com/2013/07/02/data-warehousing-business-intelligence-and-cloud-computing/

External links for reference: http://www.sap.com/index.epx
http://www.oracle.comhttp://www.tibco.com/,http://spotfire.tibco.com/,
http://scn.sap.com/thread/1228659
S
AP XI: http://help.sap.com/saphelp_nw04/helpdata/en/9b/821140d72dc442e10000000a1550b0/content.htm

Oracle Web centre: http://www.oracle.com/technetwork/middleware/webcenter/suite/overview/index.html

CMS: http://www.joomla.org/,http://www.liferay.com/http://www-03.ibm.com/software/products/us/en/filecontmana/
Hadoop: http://hadoop.apache.org/

Map reduce: http://hadoop.apache.org/docs/stable/mapred_tutorial.html
f
acebook API: https://developers.facebook.com/docs/reference/apis/
L
inkedin API: http://developer.linkedin.com/apis
T
witter API: https://dev.twitter.com/

Approach to Best collaboration Management system

Collaboration tools integrated offering (course grain integration using ) integration tools like TIBCO, Oracle BPEL, : Components to be integrated:
1. Content management system CMS  (SharePoint, Joomla, drupal) and
2. Document Management system like (liferay, Document-um, IBM file-net) can be integrated using flexible integration tools.

3. Communication platform like Windows Communication Foundation ,IBM lotus notes integrated with mail client and Social network like Facebook using Facebook API, LinkedIn API, twitter API ,skype API to direct plugin as well as data Analysis of Social networking platform unstructured data captured of the collaboration for the project discussion.
soft-phone using Skype offering recording conversation facility for later use.

https://sandyclassic.wordpress.com/2013/06/19/how-to-do-social-media-analysis/

Oracle Web centre:
https://sandyclassic.wordpress.com/2011/11/04/new-social-computing-war-oracle-web-centre/
4. Integrated Project specific Wikki/Sharepoint/other CMS pages integrated with PMO site Artefacts, Enterprise Architecture Artefacts.
5. seamless integration to Enterprise Search using Endeca or Microsoft FAST for discovery of document, information, answers from indexed,tagged repository of data.
6. Structured and Unstructured data : hosted on Hadoop clusters using Map-reduce algorithm to Analyse data, consolidate data using Hadoop Hive, HBase and mining to discover hidden information using data mining library in Mahout for unstructured data.
Structured data kept in RDBMS clusters like RAC rapid application clusters.
https://sandyclassic.wordpress.com/2011/10/19/hadoop-its-relation-to-new-architecture-enterprise-datawarehouse/


https://sandyclassic.wordpress.com/2013/07/02/data-warehousing-business-intelligence-and-cloud-computing/
7. Integrated with Domain specific Enterprise resource planning ERP packages the communication, collaboration,Discovery, Search layer.
8. All integrated with mesh up architecture providing real-time information maps of resource located and information of nearest help.
9. messaging and communication layer integrated with all on-line company software.
10.Process Orchestration and integration Using Business Process Management tool BPM tool, PEGA BPM, Jboss BPM , windows workflow foundation depending landscape used.
11. Private cloud integration using Oracle cloud , Microsoft Azure, Eucalyptus, open Nebula integrated with web API other web platform landscape.
https://sandyclassic.wordpress.com/2011/10/20/infrastructure-as-service-iaas-offerings-and-tools-in-market-trends/
12. Integrated BI system with real time information access by tools like TIBCO spotfire which can analyse real time data flowing between integrated systems.
Data centre API and virtualisation plaform can also throw in data for analysis to hadoop cluster.
External links for reference: http://www.sap.com/index.epx
http://www.oracle.com, http://www.tibco.com/,http://spotfire.tibco.com/,
http://scn.sap.com/thread/1228659
S
AP XI: http://help.sap.com/saphelp_nw04/helpdata/en/9b/821140d72dc442e10000000a1550b0/content.htm

Oracle Web centre: http://www.oracle.com/technetwork/middleware/webcenter/suite/overview/index.html

CMS: http://www.joomla.org/,http://www.liferay.com/http://www-03.ibm.com/software/products/us/en/filecontmana/
Hadoop: http://hadoop.apache.org/

Map reduce: http://hadoop.apache.org/docs/stable/mapred_tutorial.html
f
acebook API: https://developers.facebook.com/docs/reference/apis/
L
inkedin API: http://developer.linkedin.com/apis
T
witter API: https://dev.twitter.com/

PC\Laptop will never be dead although new platform emerge: Analysis of Microsoft Strategy

PC / laptop may be dead or it will become centre piece of interaction of all devices at home.
Now as internet of things evolve or semantic agents start searching  web for you and customize search for you.
There will more than 100 devices like fan , cooler, heater, washing machine , each room sensor etc in your home as Home computing/smart city emerges platform like Zigbee, personal area network become more visible. PC will become like server controlling/configuring/updating/debugging all these devices at home.
This is in response to this news I am writing:
that Microsoft is trying to keep PC as device of choice.
http://www.bloomberg.com/news/2013-09-19/microsoft-ceo-says-working-to-keep-pc-device-of-choice-.html
Some places where low computation and mobilty is required smartphone and tablet may take up market which they already have but still PC/laptop will have its own market as it will become Home server of choice.
At end of day you want to come back home and sink all your devices to server which is Laptop with max processing power to do it fast.

Strategies For Software Services/product Companies next decade

 

 

 

These requirement are going to stay for next decade:Strategy-Small1Where can Software services/product firms lay emphasis for next stage of development. Or the areas which will see maximum amount of work coming in future..

Or What areas of knowledge should software companies develop manpower on:
1. Game development and Gamification:
https://sandyclassic.wordpress.com/2012/06/27/future-of-flex-flash-gamification-of-erp-enterprise-software-augmented-reality-on-mobile-apps-iptv/

read: https://sandyclassic.wordpress.com/2013/09/16/new-age-enterprise-resource-planning-systems/

2-7. Each of the Seven areas in development:
https://sandyclassic.wordpress.com/2013/09/18/new-breed-of-app-development-is-here/

read: https://sandyclassic.wordpress.com/2013/09/20/next-generation-application-developement/

As you read you realize software which can take advantage of multiple processor available on the devices None of sotware present in market today is written to take advantage of this fact. It may be possible an new language may come up to take benefit of this fact of we can still use old java/C++ threads more offen or we can distribute load on server by more specific COM/ DCOM or Distributed Common Request broker Architecture CORBA to processor level at server.. We have virtual switches and VM ware or Zen virtualisation which can exploit maximum benefit from it.
8. More virtualised network stack: this I wrote 2 yrs back still valid to quote here:
https://sandyclassic.wordpress.com/2012/07/16/cloud-innovation-heating-up-network-protocol-stack-and-telecom-stack/

private and public cloud new API will emerge: https://sandyclassic.wordpress.com/2011/10/20/infrastructure-as-service-iaas-offerings-and-tools-in-market-trends/

9. from SDLC V model to Agile and now to lean Agile ..use of six sigma to control process is just one part of mathematics being used for quality control but there would be new data model which will be tested based to mathematical modelling like probability distributions new model industry specific models would keep emerging.
like how for security project how security user stories are plugged into model
https://sandyclassic.wordpress.com/2013/01/05/agile-project-management-for-security-project/
or read https://sandyclassic.wordpress.com/2012/11/12/do-we-really-need-uml-today/

10.  BI would be Everyware:
https://sandyclassic.wordpress.com/2013/09/20/next-generation-application-developement/
parallelism , map reduce algorithm and cloud
https://sandyclassic.wordpress.com/2011/10/19/hadoop-its-relation-to-new-architecture-enterprise-datawarehouse/

Next generation Application development

The Next generation application development will not only take care of utilizing 50 or 100+ processors which will be available in you laptop or desktop or mobile but by using parallel processing available at clients
https://sandyclassic.wordpress.com/2012/11/11/parallel-programming-take-advantage-of-multi-core-processors-using-parallel-studio/
I covered 7 points last article this is part -2 of
https://sandyclassic.wordpress.com/2013/09/18/new-breed-of-app-development-is-here/
also Next genration ERP read first: https://sandyclassic.wordpress.com/2013/09/16/new-age-enterprise-resource-planning-systems/
8. More pervasive BI eating App: Business Intelligence application development will go deeper in organisation Hierarchy
Oraganisation Hirearchyfrom more strategic level BI  and Middle management level to more pervasive  transactional processing level , and Office automation System level BI (shown in diagram as knowledge level or operational level.)

How it will affect architecture of Enterprise product Read SAP HANA
https://sandyclassic.wordpress.com/2011/11/04/architecture-and-sap-hana-vs-oracle-exadata-competitive-analysis/
Understanding Management aspect to little contrary view but related.. there will be need for more deeper strategic Information system to make more unstructured decision making.
https://sandyclassic.wordpress.com/2013/01/31/strategic-information-systems-will-be-in-focus-again-next-5-yrs/

pervasive BI bound to eat up Application development market also fulled by in-memory products like cognos TM1, SAP HANA etc..but also changes, cross functional innovation happening at enterprise level.
read :https://sandyclassic.wordpress.com/2013/09/18/new-breed-of-app-development-is-here/

As with these products no need for separate Database for datawarehouse and for operational systems. This unification of Operational data store ODS and data warehouse DW. on reporting level both Business intelligence BI and operational reporting will be accessing same database and that will be using in Memory technology.

9. Bigdata as everyone knows is Hot: more unstructured data than structured data today present for you is like open laboratory to experiment. More of it will find place in strategic management system and Management Information system.
read more details: https://sandyclassic.wordpress.com/2013/06/18/bigdatacloud-business-intelligence-and-analytics/

Read Application in security for metadata analysis : https://sandyclassic.wordpress.com/2013/06/18/how-to-maintain-privacy-with-surveillance/

10. Application security will be important as never before: its already there .
The intensity can be gauged from fact that changes in top 10 OWASP list is happening as never before and positions are changing in terms of top most risk ranking.
https://www.owasp.org/index.php/Top_10_2013-Top_10

list before:

https://www.owasp.org/index.php/Top_10_2010-Main

2010 A2 was Cross site Scripting XSS but 2013 at ranking to of perceived risk is Broken Authentication and session management. Changes do happen but here ranking and no of incident changing fast because momentum is fast.
11. More will continue when I find time next time….

How to solve Fan trap and Chasm trap?

In BI system Fan trap and chasm trap are common problem When designing a Universe (semantic Layer) which is used by BI reports to dynamically generate query.
The query information is passed to other system using CWXML (common warehouse XML files) this makes query data inter-operable to desperate systems requiring various different software landscape.
Fan Trap: happen when Object A representing table is mapped to another object B in 1:m cardinality. Which is also mapped to Object C in 1:m cardinality.
This WHEN this happens it lead to double or triple values in summary numerical attributes measures when query generated over them.
A (5) –> B(5,5) = may have value 10 then B –> C may have over calculated summaries c (5,5,5)=15.
A (Emp, salary) now B(dept, emp), C(section, dept).. now you can clearly see 1:m relationship between tables. as explained above the Emp,dept,sum(salary) would have 3 times or more over calculated values when dynamic query is genrated by semantic Layer. this is Called Fan Trap:
This can be solved by using Aliases, aggragate awareness functions @object, @ functions..

Chasm trap: A –> B (1:m) and B –> C (m:1) when relationship between objects is of this type it leads to Chasm trap.
There Chasm trap can also be solved by using aggregate awareness functions @userObjects etc…
Along with this loops are common problem in BI designing ?
Loops are resolved by setting context, which actually defines the path query is going to takes thus resolving ambiguity of join suppose A,B,C are joined but there are in web of tables which join happens dynamically by BI system it can take path like
join path 1: A, B, D1, D2, C
or
join path 2: A, B, D3, D4, C
Which introduces loops in BI semantic layer is systems like SAP Business Objects, IBM cognos or Micro strategy. Because as report utilizes the semantic objects directly and tool creates query as defined by semantic layer by BI architect it leads to loops.
the two intermediary routes available to tool creates two different types of query and hence two different types of results which leads to distortions in values and duplicate values on reports.
There are resolved by defining path by setting context so suppose we say always when A,B,C join use path 1 by using context.

New Breed of App development is here

Here are reasons Why next generation app will be totally different:
1. – In few years we will be seeing ending dominance of physical routers, switches , firewall to virtual soft switches, virtual routers , software defined routers and switches. More open routing technology would be program driven rather than configuration on boxes.
Companies like application firewall maker Palo Alto Networks and virtual programmable router maker nicira have huge role to play.
https://sandyclassic.wordpress.com/2012/07/16/cloud-innovation-heating-up-network-protocol-stack-and-telecom-stack/

its also affected by trends in Network technology
https://sandyclassic.wordpress.com/2012/09/11/trends-in-computer-networking-and-communication-2/
2. – in next year we will see 20+ processors on single machine making parallel processing one of important requirement. Huge software would be re written to meet this requirement.
https://sandyclassic.wordpress.com/2012/11/11/parallel-programming-take-advantage-of-multi-core-processors-using-parallel-studio/

3. The changes in business and systems are occurring very fast as system and getting more understood and cross functional due to intense competition Where only innovation can make you stay ahead of curve: Read more reasons why?
https://sandyclassic.wordpress.com/2013/09/16/new-age-enterprise-resource-planning-systems/

4. Cloud will increase innovation to change way we think about software:
Software As service SAAS, PAAS, IAAS going to make more deeper innovation as defined in above article (https://sandyclassic.wordpress.com/2013/07/02/data-warehousing-business-intelligence-and-cloud-computing/).
How innovation on cloud will be much quicker read :
https://sandyclassic.wordpress.com/2013/07/02/data-warehousing-business-intelligence-and-cloud-computing/

5. Laptop will never go (large screen requirement) but Mobile will be mass platform:
As we can move we can see virtually wearable shirts made of graphene with storage and data streamed on walls .. as when we want we can just grab wall data to graphene shirts..
Read more about Graphene: https://sandyclassic.wordpress.com/2013/01/18/graphene-the-wonder-material-foldable-cell-phones-wearable-computerbionic-devices-soon-reality/
surfaces will keep emerging we would see virtually display in air without any device but what it would be added with augmented reality and virtual reality.
https://sandyclassic.wordpress.com/2012/06/27/future-of-flex-flash-gamification-of-erp-enterprise-software-augmented-reality-on-mobile-apps-iptv/
we can in future just stream data to wall and program on wall outside our house.
6. Internet of things : where Machine to machine transfer of information and data and semantic web will make possible more intelligent feedback to user by all devices based on user need. so when you pick up milk from shelf next time. your fridge will search for you and alert you on latest offer of cheapest milk from various retailer.
And it will be displayed on fridge itself.. not only that it would order for you when its empty if you configure so. it will calculate you calorie consumed by family of fridge item and send updates to doctor monitoring you and display return messages from doctors.
More: https://sandyclassic.wordpress.com/2013/05/03/classifying-ubiquitious-data-images-into-emotion-for-target-advertisement-campaign/
7. Sensors will be everywhere and huge and Ubiquity will rule :
https://sandyclassic.wordpress.com/2012/10/28/ubiquity-the-most-crucial-challenge-in-business-intelligence/

New age Enterprise resource planning systems

Activity based accounting has changed the accounting system where even cost centre inputs to bottom line is also appreciated , calculated and accounted and apportionment is run not only to profit centre but also to cost centre.

This led to renewed influence of new cost centre based new module reporting like Human resource Accounting/Analytic ( Profit centre based system were preferred early and coast centre were neglected )which not only introduced new module in the Enterprise Resource planning ERP also changed the interlinking between modules such as Human resource management system , human resource accounting influence to General ledger and to profit and loss account.

– as each activity is apportioned into management accounting there are changes which are happening in the Analytics as more deeper ,cross functional analytic measure are used last 5 yrs leading to huge changes in business thinking for top line and bottom line growth.
– as BI becomes pervasive and ubiquitous it leads to deeper granular analysis to system thinking by lower level staff leading to bottom up innovation.
https://sandyclassic.wordpress.com/2013/05/03/classifying-ubiquitious-data-images-into-emotion-for-target-advertisement-campaign/
cloud and mobility has introduced pay per use model which influenced more pervasive BI and ERP usage by all staff giving fillip to bottom up thinking. Capital expenditure changed to operating expenditure leading to more acceptability to mid size companies as well large scale companies.
– real time updates using sensor based tracking of supply chain items , stock keeping unit SKU in Retail and in-memory system (SAP HANA, Oracle Exadata, IBM Cognos TM1)  making update faster and possibility of including more compressed data into primary memory for analysis.
https://sandyclassic.wordpress.com/2011/11/04/architecture-and-sap-hana-vs-oracle-exadata-competitive-analysis/

Gamification/AJAXifying of ERP:
https://sandyclassic.wordpress.com/2012/06/27/future-of-flex-flash-gamification-of-erp-enterprise-software-augmented-reality-on-mobile-apps-iptv/
A
dobe forms and increasing replaced SAP forms and even Oracle apps forms in AJAXified ERP systems. Augmented reality on AJAX making possible Gamification of ERP.
Javascript and AJAX dominates the Java on client side. increasing used of Node.js making server side javascript dominance a possibility with less requirement for strictly typed languages like Java and easy callback references.
https://sandyclassic.wordpress.com/2013/05/03/classifying-ubiquitious-data-images-into-emotion-for-target-advertisement-campaign/