<?xml version="1.0" encoding="UTF-8"?>
<article xmlns:xlink="http://www.w3.org/1999/xlink">
<front><article-meta>
<title-group><article-title>Development of the Efforts-Based Outlook Learning Models Using Information Set Theory</article-title></title-group>
<contrib-group>
<contrib contrib-type="author"><name><surname>Hanmandlu</surname><given-names>Madasu</given-names></name><xref ref-type="aff" rid="aff1"/></contrib>
<contrib contrib-type="author"><name><surname>Grover</surname><given-names>Jyotsana</given-names></name><xref ref-type="aff" rid="aff2"/></contrib>
<aff id="aff1">Department of Electrical Engineering, Indian Institute of Technology Delhi, Hauz Khas, New Delhi 110016, India.</aff>
<aff id="aff2">Birla Institute of Technology and Science, Pilani, India.</aff>
</contrib-group>
<abstract><p>This paper presents the conceptualization of efforts in the formulation of Effort-Based Outlook Learning Models (EB-OLMs), named as Efforts that Disregard Outcome (EDO), Efforts to Raise Outcome (ERO), and Efforts to Steel Outcome (ESO). The efforts are put in to achieve a goal or an objective by a contender for success. The outlook of each contender is modelled by the way efforts are contemplated. We have used some of the elements of the information set theory in the construction of EB-OLMs. The superiority of these models over some well-known Meta-heuristic techniques is demonstrated on some standard optimization functions. The design of both the classifier and predictor showcases the applicability of EB-OLMS in learning their parameters through two case studies. The first case study presents the formulation of a classifier for the detection of retinal diseases, whereas the second case study is that of a predictor for the prediction of heart diseases.</p></abstract>
<kwd-group kwd-group-type="author"><kwd>Efforts that disregard outcome</kwd><kwd>Efforts to raise outcome</kwd><kwd>Efforts to steel outcome</kwd><kwd>Effort-based</kwd></kwd-group>
</article-meta></front>
<body>
<sec id="sec-1">
<p>outlook learning model, Information set, Pervasive information set.</p>
</sec>
<sec id="sec-2"><label>1</label><title>Introduction</title>
<p>Learning is an ongoing process in humans from childhood onwards by interaction with the mother in the early years and then with the outside world via communication. The initial efforts on human learning in <xref ref-type="bibr" rid="ref-1">[1]</xref> include the proposition of Teacher-Learner Based Optimization (TLBO) where a student learns from his/her teacher and takes help from his/her friends, development of the JAYA algorithm by improving TLBO in <xref ref-type="bibr" rid="ref-2">[2]</xref>, and formulation of three metaphor-less algorithms for solving the optimization problems in <xref ref-type="bibr" rid="ref-4">[3]</xref> towards the betterment of their previous methods.</p>
<p>An evolutionary learning model, called Human Effort for Achieving Goals (HEFAG) in <xref ref-type="bibr" rid="ref-5">[4]</xref>, is leveraged upon the information concept to learn its parameters. In this model, a contender for success engages self-effort exceeding the average effort while competing with the best achiever at the emulation phase, but updates this effort by an incremental effort from any two fellow contenders while cooperating with them at the boosting phase.</p>
<p>As an extension of the above, two more learning models clubbed under the title called Competitive-Cooperative Learning Models (CCLMs) in <xref ref-type="bibr" rid="ref-6">[5]</xref> are based on a higher form of information set concept, such as Hanman Transform (HT) and pervasive information values, elaborated later.</p>
<p>In the first approach, the competition with the best achiever is represented as the difference between the HT values of a contender and the best achiever, whereas that between the pervasive information values in the second approach. Both approaches use the difference between the HT values of two randomly selected fellow contenders to augment the first difference in the update equation of the learning model.</p>
<p>Recently, a prudent learning model was developed by Grover and Hanmandlu <xref ref-type="bibr" rid="ref-7">[6]</xref> in which competition is done with both the best and the least achievers, thus solely favouring the competition as a success mantra. In this work, we would like to investigate how each type of effort would lead to a different kind of outlook that has a bearing on the learning behaviour. We will also show the utility of outlook learning in solving several problems. The motivation for this work stems from the desire to utilize the certainty/uncertainty representation as the backbone of modelling the variables of any kind having their own distributions amenable to fit with the mathematical models.</p>
<p>The objectives of this paper are: 1) to expose the concepts of information sets, 2) to derive the HT divergence and pervasive HT, 3) formulation of three efforts-based learning models, 4) to illustrate the power of certainty/uncertainty representation on two case studies, and 5) to deliberate on the suitability of the information set concepts for the modelling of certain modules.</p>
<p>The rest of the paper is structured as follows: Section 1 presents the characterization of an outlook resulting from three types of efforts. The rudiments of the information set theory are covered in Section 3, and the formulation of the Efforts-Based Outlook Learning Models (EB-OLMs) is given in Section 4. The design of an information set-based classifier, regression-based predictor, and DeepInfoNet-based GAN, including an exposition of rough information sets, is the concern of Section 5. Two case studies, with the first on the detection of retinal diseases using the classifier and the second on the prediction of heart diseases using the predictor, are discussed in Section 6, where their parameters are learned using the proposed EB-OLMs. The conclusions are relegated to Section 7.</p>
</sec>
<sec id="sec-3"><label>2</label><title>The Characterization of Efforts-Based Outlook Learning Models</title>
<p>The activities are of different kinds, such as business, economic, sports, religious, community, etc., and these are performed through efforts by an individual or a group to achieve a purpose or an objective. For any activity, say, a learning activity, the efforts have to be put in to achieve a goal. The way the efforts are made while performing an activity reflects the attitude of a person towards life. Hence, the efforts mirror the human outlook. As a matter of fact, we need not associate any outlook with the efforts related to an activity. In that case, we would be disregarding the variability in the efforts. But we want to see this variability in one’s efforts as a reflection of his/her outlook.</p>
<p>In this, we focus on the efforts of a contender aimed at an activity that involves finding a solution to a problem. We assume a group or population of contenders each trying to find an optimal solution by optimizing an objective function. We propose to categorize the efforts of each contender into three types, with each type leading to one kind of outlook. It is opined that a contender can display any one of the three kinds of outlooks depending on how he/she performs in the efforts to achieve the goal. The first type of efforts that aim at gaining his/her own outcome without ever bothering about the outcomes of others leads to an outlook termed as “Efforts that Disregard Outcome (EDO)” abbreviated as EDO, and the contender with this outlook mode is therefore termed as EDOY.</p>
<p>The second type of efforts is the result of possessing the competitive spirit in a contender. In this mode, the contender compares his/her outcome of efforts with those of other contenders and then tries to raise his/her outcome through increased efforts to score over the best performing contender, called the best achiever. This type of effort is termed as “Efforts to Raise Output (ERO)” abbreviated as ERO, and the contender displaying this outlook mode is termed as EROY.</p>
<p>The third kind of effort prefers stealing the outcome of another contender instead of earning his/her own outcome, as the contender seeks an easy way to achieve a goal. Hence, his/her efforts are directed in eyeing others’ outcomes rather than exerting them. So, the efforts are termed as “Efforts to Steal Outcome (ESO)” abbreviated as ESO, and the contender in this outlook mode is termed as ESOY.</p>
<p>A contender can be in any outlook at any time depending on what triggers in him/her on seeing the outcome of his/her efforts. But success weds a contender when he/she cherishes all kinds of outlooks. Moreover, while expressing an outlook as a learning component, we need the mathematical support that is forthcoming from information set theory. We utilize all three learning outlook components together to minimize the loss function to reach the goal.</p>
<p>Moreover, we intend to seek a population-based evolutionary learning in which several contenders participate to achieve the goal. There exist several strategies of species such as ants, birds, bacteria, particles, animals, etc. to explore the solution paths in the search space, and the final solution is reached by attaining the minimal loss function value. As humans are gifted with better skills than those of species because of their communication abilities, we prefer to deal with their outlooks towards learning.</p>
<p>The loss functions consisting of the unknown parameters are problem-specific but domain independent, and they are framed to reflect what is to be achieved from a problem. In our case, the problem is to achieve a goal by an appropriate choice of efforts. The goal is achieved if and only if the loss function attains the minimum value. The loss function is taken as a function of the error between what is expected and what is obtained from efforts, called an outcome. However, depending on the complexity of a loss function that grows in proportion to the number of unknown parameters, its minimization through learning of these parameters by the classical optimization techniques becomes difficult. So, we go in for evolutionary learning methods that employ a set of populations to search the solution space.</p>
<p>To meet our objective, the number of populations is the same as the number of contenders. The efforts, i.e., the unknown parameters, in the loss function are learned by minimizing it.</p>
</sec>
<sec id="sec-4"><label>3</label><title>A Brief Note on Information Sets</title>
<p>Based on the above concepts, the representation of either certainty or uncertainty associated with the attribute, termed the Information Source (IS) values, rules gains prominence because of its problem-solving abilities. The choice of either certainty or uncertainty representation is important for a particular application. The importance of this choice will be clear in the case studies.</p>
<p>A set of IS values, for the sake of generalization in the terminology of the information set theory, is modeled by a mathematical function called the Membership Function (MF) by assuming a distribution which could be statistical, like Gaussian /generalized Gaussian, or random, like exponential. In a fuzzy set, a pair comprising an attribute value and the corresponding MF value is an element. The MF value connects the attribute value with a degree of association to the set. As such, the complement MF is deprived of association to the set. This drawback is mitigated in the information set constituting a set of information values, which results from the certainty/uncertainty representation of IS values through the Hanman-Anirban (HA) entropy function <xref ref-type="bibr" rid="ref-8">[7]</xref>, by which the two components of each pair are merged into a product called an information value, thus invalidating the degree of association. The significance of the variable is judged by how much certainty/uncertainty it owes to the information set. The HA entropy function is the offshoot of the Pal and Pal (PP) entropy function <xref ref-type="bibr" rid="ref-9">[8]</xref>, and this being information theoretic can deal with both the probabilistic, Px and possibilistic IS values, Ix and is defined as:</p>
<p>1 3 2</p>
<p>HA −(aIxi+bIxi+cIxi+d)</p>
<p>H = ∑{Ixie }, (1)</p>
<p>1 2 2 2</p>
<p>with substitution of a = 0, b = , c = I/ ̅ σ and d = I̅ /2σ for its parameters based on the statistical</p>
<p>2 x x 2σx</p>
<p>parameters: I ( the mean) and σx (the variance), Eq. 1 becomes:</p>
<p>HA</p>
<p>H = ∑ Ixiμxi, (2)</p>
<p>(I −I̅) xi 2σx</p>
<p>where μxi = e is the Gaussian MF derived from the polynomial exponential gain function and the</p>
<p>HA</p>
<p>product Ixiμxi is the information value with the set denoted by: H (I) = {Ixiμxi}.</p>
<p>The Mamta-Hanman (MH) entropy function in <xref ref-type="bibr" rid="ref-10">[9]</xref> generalizes the HA entropy function by modifying both the exponential gain function and IS values as follows:</p>
<p>1 α β</p>
<p>MH γ −(cI +d)</p>
<p>H = ∑ I e xi , (3)</p>
<p>p xi</p>
<p>MH</p>
<p>where α, β, γ, c, and d are the real constant parameters. Representing Eq. 3 similar to Eq. 2, we get, Hp =</p>
<p>1 n γ β β</p>
<p>∑i=1 I μ , where μ is the generalized Gaussian MF that takes different shapes for the values of β in the</p>
<p>n xi xi xi</p>
<p>range (0, 5).</p>
<p>The gain function need not be from the same set of IS values, Iyi , it could be from another set, Iyi. To represent this, we make use of the Adaptive Heterogeneous (AH) HA entropy function, given by</p>
<p>1 3 2</p>
<p>HA −(ayIyi+byIyi+cyIyi+dy)</p>
<p>Hah = ∑{Ixie }. (4)</p>
<p>−y ̅ 2</p>
<p>1 −y ̅ 2</p>
<p>By choosing ay = 0, by = , cy = and dy = where y ̅ is the mean, and σy is the variance in Eq. (4), we</p>
<p>2 2 2</p>
<p>2σy σy 2σy</p>
<p>obtain,</p>
<p>HA</p>
<p>Hh = ∑ Ixiμyi, (5)</p>
<p>where μyi, the Gaussian MF defined based on the distribution of {Iyi} is evaluating another distribution {Ixi}. Unlike in a fuzzy set, an MF here is empowered to act as an agent that can work on probabilities, assume a negative role as the complement, and become an evaluator, thereby having an extended scope outside the four walls of degree of association.</p>
<p>Representation of higher-level certainty/uncertainty representation: a brief note on the representation of certainty/ uncertainty is the need of the hour. Any variable having the IS values in a set can have either a statistical distribution (i.e., it can be fitted with a Gaussian MF), or a random distribution (i.e., it can be fitted with an exponential function). Application HA entropy converts the IS values into the information values, the sum of which yields the former case, whereas uncertainty in the latter case. The original impetus for the uncertainty representation is provided in <xref ref-type="bibr" rid="ref-11">[10]</xref>. For the higher-level representation of uncertainty, the possibilistic transforms based on the adaptive HA and MH entropy functions only provide recourse. These transforms are vital to the development of not only the learning models but also the design of a classifier and predictor in this paper.</p>
<p>To derive the HT, we invoke the adaptive HA entropy function in which the parameters are variables. This is defined as <xref ref-type="bibr" rid="ref-12">[11]</xref>,</p>
<p>1 3 2</p>
<p>HA −(axIxi+bxIxi+cxIxi+dx)</p>
<p>Ha = ∑ {Ixie } . (6)</p>
<p>For ax = bx = dx = 0 and cx = μxi , Eq. 6 becomes HT derived for the first time in <xref ref-type="bibr" rid="ref-13">[12]</xref>:</p>
<p>HA −μxiIxi</p>
<p>HT = ∑ Ixie . (7)</p>
<p>1 γ β MH n −I μ</p>
<p>The corresponding MH transform is obtained as H = ∑ I e xi xi from the adaptive version of the</p>
<p>T i=1 xi</p>
<p>MH entropy function <xref ref-type="bibr" rid="ref-14">[13]</xref> on replacing c with cx = μxi and d with dx = 0 in Eq. (3). This is a higher-level representation of uncertainty because the exponential gain function is a function of the information values, μxiIxi, which leads to either certainty or uncertainty depending on whether the agent μxi is from a statistical or random distribution. We will now derive some extensions of HT necessary for the learning model. Outcome-based HT: while dealing with an optimization problem involving the learning of the unknown parameters, denoted by a weight vector, wi termed as an effort vector using an evolutionary and population-based learning. We invariably employ several competitors, each of which finds a fitness/outcome by applying wi on an objective function, fk = F(rs, wk), where rs is the resource and wk is the effort vector of the kth competitor. There are as many outcomes as the number of competitors. We can easily determine the outcome based on the kth MF, μ based on f and f Then, the outcome-based HT can be written as:</p>
<p>fk k av.</p>
<p>HA −μfiwi</p>
<p>HfT = ∑ wie . (8)</p>
<p>We will be using this formula in the EB-OLM discussed later.</p>
<p>Derivation of the divergent HT and HT ratio: to this effect, consider two ISs Ixi and Iyi with the corresponding MFs, μxi and μyi. The difference between their information is computed from:</p>
<p>∆Hi = Iyiμyi − Ixiμxi. (9)</p>
<p>We will now incorporate ∆Hi from Eq. (9) by setting ax, bx to 0, cx = −μx and dx = μyiIyi into Eq. (6) to result in what we call the HT divergence that gives the uncertainty because of the external agent, μyi:</p>
<p>H −(μyiIyi−μxiIxi)</p>
<p>H∆T = ∑ {Ixie } . (10)</p>
<p>Note that the parameters ax, bxand cx contribute to the internal agent, μxi whereas dx, to the external agent, μyi.</p>
<p>Dividing the above ∆Hi by Iyiμyi, we get the change in the information ratio as:</p>
<p>∆Hi Ixiμxi</p>
<p>= 1 − . (11)</p>
<p>Iyiμyi Iyiμyi By taking the ratio between two information values from Eq. (11), setting ax and bx to 0, dx = −1 and cx = μxi/(Iyiμyi) and then using the logarithmic approximation in Eq. (6) convert it into the Kullback-Leibler (KL) divergence as follows:</p>
<p>μxiIxi</p>
<p>1 −( −1) 1 μxiIxi</p>
<p>H μyiIyi</p>
<p>HRT = ∑ Ixie = − ∑ Ixilog( ). (12)</p>
<p>n n μyiIyi</p>
<p>i=1 i=1 We will now show how a non-Membership Function (nMF) can have a role in ameliorating the inaccurate fuzzy modelling. This development has led to the emergence of a pervasive Membership Function (pMF). Pervasive information set: when the fuzzy model, MF, i.e. μxi, is unable to model the distribution satisfactorily, then the intuitionistic fuzzy set due to Atanassov <xref ref-type="bibr" rid="ref-15">[14]</xref> comes to our rescue by introducing an nMF, i.e. vxi , to correct for the deficiency in MF. How much their sum value deviates from 1 evokes the concept of hesitancy, given by:</p>
<p>hxi = 1 − (μxi + vxi) = 1 − Pxi. (13)</p>
<p>In order to vary the values of hesitancy, a hesitancy degree, γ is taken as the power on both μxi and vxi.</p>
<p>γ γ γ</p>
<p>γ. hxi = 1 − (μ +v ) = 1-P . (14)</p>
<p>xi xi xi</p>
<p>We reveal the importance of Eqs. (13) and (14) in passing, as their differencing has led to the birth of incremental hesitancy features that are used in the design of a color-based detector for detection of sign boards from the world scenes in <xref ref-type="bibr" rid="ref-16">[15]</xref>. In this work, we are concerned with the pMF, denoted by Pxi and the variable pervasive MF, denoted by P . They are the sum of MF and nMF. The pervasive information set</p>
<p>xi</p>
<p>denoted by {Ixi. P } extends the information set to encompass the intuitionistic fuzzy set by borrowing terms</p>
<p>xi</p>
<p>like nMF, hesitancy degree, and hesitancy function into its fold. To get over the unavailability of vxi, we</p>
<p>s 1/s</p>
<p>replenish it with the Yager complement of μxi, (1 − μxi) , where s is a scale parameter to fine-tune its value.</p>
<p>γ γ 1 −</p>
<p>Replacing μ with P converts the HT into the pervasive Hanman Transform (pHT), = ∑ =1 .</p>
<p>xi xi</p>
<p>This is of interest in the formulation of the Outlook Learning Models (OLMs).</p>
</sec>
<sec id="sec-5"><label>4</label><title>Formulation of Outlook Learning Models</title>
<p>The three kinds of outlook are proposed depending on how a contender for success conceptualizes the efforts with regard to an outcome. The three perceived outlooks are due to the EDO, ERO, and ESO. We make an important assumption that all the contenders make efforts under these three independent categories, so that their influences are additive. The non-additive case is not taken up here for the sake of simplicity in modelling.</p>
<p>The contender with EDO characteristic is termed as EDOY, and that with ERO characteristic is termed as EROY. Lastly, the contender with ESO characteristics is termed ESOY. As we are attempting to learn, let us pinpoint their specific characteristics suitable for learning.</p>
<p>The learning component in EDO mode doesn’t depend on the outcome of one’s efforts. Whatever one does is aimed at gaining experience sans competition with others. In the parlance of information set theory, EDOY gauges his/her efforts based on how much they have contributed to the output. In ERO mode, EROY compares his/her performance in terms of the outcome of his/her efforts with that of the best achiever. In the ESO model, ESOY is bent on usurping the fruits of others’ labour or simply saying, they snatch away the outcomes of others’ efforts.</p>
<p>Now the ground is set for the formulation of EB-OLM. Let F (x, w) be a function of resource values x and the unknown parameters as the IS values in the learning model. The three components of the learning model enter into a race to learn these parameters by optimizing an objective function.</p>
<p>Let us first focus on the component of EDO. EDOY doesn’t compete with anybody and doesn’t expect an outcome commensurate with his/her efforts. We will use the pervasive HT to update the efforts of EDOY. The component of EFO strives to improve his/her outcome as he/she competes with the best performer by making efforts. We can use either HT divergence or HT ratio to update the efforts of EROY.</p>
<p>The component of ESO tries to steal the fruits of others’ efforts. This behavior is opposite to the EDO mode that shuns all sorts of external inducements.</p>
<p>In our deliberations on learning, we are concerned with the representation of certainty in the efforts, which arises from fitting their distribution with a suitable MF. The efforts of EDOY, EROY and ESOY are denoted by “w” with three arguments.</p>
<p>The first one denotes the tth iteration, the second one denotes the kth contender; it could be one of the three kinds of outlook: EDOY, EROY and ESOY, denoted by D, R and S as subscripts on w respectively, and the third one denotes the lth effort. Accordingly, the weight/effort vectors of EDO, EfgvRO and ESO are w (t, k, l), wR (t, k, l) and wS (t, k, l). The overall weight vector isw2(t, k, l).</p>
<p>As an EROY competes with others, we assume it to be the best-performing contender or best achiever, whose effort is denoted by w (t, best, l). To evaluate the outcome of any contender, all the efforts are needed. As we are interested in developing the learning model, our objective is to learn the efforts of the kth contender, that is destined to play a role as per the respective outlook perspective.</p>
<p>We now formulate the OLM learning accrued by a particular type of effort. Let us model the component of OLM earning in EDO mode in which an expectation of any sort is abhorred. As EDOY seeks knowledge, we associate two features with this mode. These include: 1) the first is reinforcement of his/her current efforts based on the previous outcomes, and 2) the second is the use of the pervasive information in the domain of activity due to the internal (self) and the external agents.</p>
<p>Notations used in the learning models: in this, x is considered here as a resource rather than an IS, Ixi. The weight vector w is dependent on the manoeuvrable iteration t, contender k, and effort l. It is therefore denoted by w (t, k, l). When all efforts, l = 1,..., L, are used, then the weight/effort vector is indicated by w(t, k). The outcome of the kth contender, symbolized by f = F(rs, w(t, k) banks upon on the resources rs and efforts l of the kth contender at iteration t.</p>
<sec id="sec-6"><label>4.1</label><title>Efforts that Disregard Outcome-Component</title>
<p>As an EDOY leverages his/her past outcomes to improve upon the present efforts, a reinforcement factor is devised as a sigmoid of an average of the (t-1) elapsed values of outcome from i =0 to i=t-1, computed as:</p>
<p>γ(t, k) = , (15)</p>
<p>−∆F(t,k)</p>
<p>1 + e</p>
<p>where the average is given by</p>
<p>1 t−1 1 t−1</p>
<p>∆F(t, k) = ∑i=1 F(rs, w(i, k)) − F(rs, w(i − 1, k)) = ∑i=1 f(i, k) − f(i − 1, k).</p>
<p>t−1 t−1</p>
<p>The above reinforcement factor is chosen to be simple, as it is not associated with a reward function based on some policy. Here, its role is to give weightage to the weight vector of EDO. For instance, we could give more weightage to the latest fitness values and the least to the past values. Note that we have suppressed the abbreviations rs and w in f. The pHT is modelled as pHT weighted with the reinforcement factor that accounts for the past outcomes, given by:</p>
<p>−μP(t,k)wD(t,k,l)</p>
<p>wD(t + 1, k, l) = γ(t, k). wD(t, k, l)e , (16)</p>
<p>−|f(t,k)−f(t−1,k)|</p>
<p>where μP(t, k) = μD(t, k) + vD(t, k) and μD(t, k) = e .</p>
</sec>
<sec id="sec-7"><label>4.2</label><title>Efforts to Raise Outcome-Component</title>
<p>In this, the HT divergence based on the difference between two information values of the best achiever, μ(t, best)w (t, best, l) and the k th contender μ(t, k)w (t, k, l) is computed using Eq. (16) as:</p>
<p>−(μ(t,best)wR(t,best,l)−μ(t,k)wR(t,k,l))</p>
<p>wR(t + 1, k, l) = wR(t, k, l)e . (17) As shown in Eq. (12), the above HT divergence can also be written as :</p>
<p>μR(t, k)wR(t, k, l)</p>
<p>wR(t + 1, k, l) = wR(t, k, l). log( ), (18)</p>
<p>μR(t, best)wR(t, best, l)</p>
<p>where the outcome-based MFs of the best achiever and the kth contender are:</p>
<p>−(fbest−fav)</p>
<p>μ (t, best) = e f ,</p>
<p>and</p>
<p>−(fk−fav)</p>
<p>μ (t, k) = e f .</p>
<p>With fbest=F(w(t, best)), fk=F(w(t, k)), and fav as the average outcome.</p>
<p>It may be noticed that we have associated the advanced concept called pervasive information and reinforcement with the EDO component of learning, as EDOY is entrusted with a plan at his disposal for the next outcome, so it is vested with the ability to utilize the past and present information. This capability is a rare kind of outlook of a contender, whereas an inquisitive higher form of information called transform is bestowed with the ERO component of learning. As ESO has a tendency to steal, we have to brace for a new concept next.</p>
</sec>
<sec id="sec-8"><label>4.3</label><title>Efforts to Steel Outcome-Component</title>
<p>We presume that the characteristic of ESOY is to steal others’ fruit ( i.e., outcome). As per the information set, MF gives an association to a concept, whereas the nMF has no allegiance to the concept. As we know, any person can develop the habit of stealing the outcome of others’ efforts (nMF) in case he/she doesn’t want to earn his/her outcome by his/her efforts (MF) or never wants to exert. Then he/she directs his/her efforts to steal; it can be presumed that ESOY eyes the other’s outcome. In that case, the component of kth ESOY is modelled as:</p>
<p>wS(t + 1, k, l) = vS(t, k, l). f(t, q), (19)</p>
<p>where we make use of the product of the nMF of the kth ESOY, v (t, k, l), and the outcome of the qth contender, f( t, q), to represent the usurping of the qth contender’s outcome by the kth contender that exerts none of its efforts. If an outcome is not produced by one’s efforts, the claim to it is said to be false. Hence, his/her MF cannot be used, but only nMF.</p>
<p>It may be noted that vS(t, k, l)is taken as the Yager complement of μS(t, k, l) that is given by</p>
<p>(wS(t,k,l)−wav(t,k)) −{ 2 }</p>
<p>2σw (20)</p>
<p>μ (t, k, l) = e S ,</p>
<p>2 th</p>
<p>where the mean denoted by wav (t, k) and the variance by σw computed based on the l efforts of all contenders.</p>
<p>The Efforts Based Outlook Learning Model (EBO-LM): having derived all three components of learning, the weight vector is updated as:</p>
<p>w(t + 1, k, l) = w(t, k, l) + r1wD(t + 1, k, l) + r2 wR(t + 1, k, l) + r3 wS(t + 1, k, l), (21)</p>
<p>where r1, r2 and r3 are the random numbers. When t=0, w (0, k, l) = 0, whereas the other three weights are initialized with random values.</p>
<p>We have refrained from discussing several ways by which the variants of the learning models can be generated, as that would distract us from our avowed objectives. So, we present an algorithm for the implementation of EB-OLM.</p>
</sec>
<sec id="sec-9"><label>4.4</label><title>An Algorithm for Effort-Based Outlook Learning Models</title>
<p>Step 1. Choose an objective function to be minimized along with the input data. Specify the number of weight vectors (populations) and the number of iterations.</p>
<p>Step 2. Assume random weight vectors. Let Iter be equal to 1.</p>
<p>Step 3. Compute the outcomes due to the randomized weight vectors and find the outcome MFs.</p>
<p>Step 4. Compute the reinforcement factor using Eq. (15) and evaluate the EDO learning component using Eq. (22).</p>
<p>Step 5. Compute the learning component of EROY using Eq. (17) or Eq. (18) by evaluating the outcome-based MFs of the best achiever and the kth contender.</p>
<p>Step 6. Compute the learning component of ESOY using Eq. (19) and find the nMF of ESOY using the effort-based MF using Eq. (20).</p>
<p>Step 7. Update the previous weight vectors using three learning components in Eq. (21).</p>
<p>Step 8. Repeat Steps 3-7 until we achieve convergence in the weight vectors or the minimum objective function value.</p>
<p>In the above algorithm, we have used all three components in the updating equation of the learning model. For the algorithms in <xref ref-type="bibr" rid="ref-4">[3]</xref>, three model equations need not be applied. Depending on the objective function, we need one or two model equations, and these are applied sequentially one after another. Very rarely do we need the third model equation. Based on this procedure, the above algorithm is modified.</p>
</sec>
<sec id="sec-10"><label>4.5</label><title>Modified Algorithm of Effort-Based Outlook Learning Models</title>
<p>Step 1. Find the reinforcement factor and evaluate the ENO learning component.</p>
<p>Step 2. Update the model equation with only the ENO component. If the objective function is reduced drastically, go to Step 3.</p>
<p>Step 3. Evaluate the outcome of the membership best performer and also of an EROY. Compute the ERO learning component.</p>
<p>Step 4. Update the model equation from Step 4 with the ERO component.</p>
<p>Step 5. If the objective function is reduced drastically, then go to Step 3.</p>
<p>Step 6. Find the nMF of ESOY using either the outcome-based or the effort-based MF and compute the ESO learning component.</p>
<p>Step 7. Update the model equation from Step 8 with the ENO component.</p>
<p>Step 8. Repeat Steps 3-10 until we achieve convergence in the weight vectors or the minimum objective function value.</p>
</sec>
</sec>
<sec id="sec-11"><label>5</label><title>Applications of Effort-Based Outlook Learning Models</title>
<p>We will briefly state some applications of this model for learning the parameters. They include:</p>
<p>I. The design of a classifier.</p>
<p>II. The formulation of regression and forecasting models.</p>
<p>III. The development of new neural networks.</p>
<sec id="sec-12"><label>5.1</label><title>The Design of a Classifier</title>
<p>The design of classifiers based on information sets can be seen in <xref ref-type="bibr" rid="ref-17">[16]</xref>. Assume that the Feature Vectors (FVs) of a dataset are normalized, and then they are split up into the training and test sets. The number of classes is assumed to be l. The length of an FV is m, and the number of FVs in a class is n. Let ftr (i, j) and fte(j) with i = 1,.., n and j = 1, ..., m be the training and test FVs be abbreviated as tFVs and teFVs respectively. Our objective is to find the statistics of all features in a class. For this, we compute the mean and the variance of each FV across all tFVs of a class to form an information set by fitting the Gaussian MF. By this procedure, we get m MFs yielding m information sets, with each set having n information values. Let μtr(i, j) be the MF vectors of ftr(i, j). Next, we evaluate their HT from:</p>
<p>H −(ftr(i,j).μtr(i,j))</p>
<p>HT,tr(i, j) = ftr(i, j)e . (22)</p>
<p>Approach 1 (Without learning). In this approach, HT is applied to tFVs of a class by finding the MF vector that requires an average tFV and a vector of variances. The FV giving the minimum HF value is termed the support vector of the class based on the certainty concept. All other FVs with higher HF values possess more certainty to the class, and hence they are well within the boundary of a class. But the support vector being on the boundary of the class is most critical. This concept was used in the design of an optimal classifier using the prudent learning model in Grover and Hanmandlu <xref ref-type="bibr" rid="ref-7">[6]</xref>. The support vector for the lth class is computed from:</p>
<p>H −(ftr(i,j).μtr(i,j))</p>
<p>HT,tr(i, l) = {∑ ftr(i, j)e } ; i = 1, . . , Ntr ; l = 1, . . , Nc,</p>
<p>(23)</p>
<p>where Ntr is the number of tFVs of each class and Nc is the number of classes. It may be noted that the subscript l on the r.h.s. of Eq. (23) indicates that the operations in the curly bracket are performed on tFVs of class l. By applying Mini on HT,tr(i, l) fetches us the minimum value of HT for the specific index im, given by</p>
<p>H H −(ftr(im,j).μtr(im,j))</p>
<p>HT,tr(im, l) = Mini{HT,tr(i, l)} = ∑ ftr( im, j)e |l.</p>
<p>(24)</p>
<p>−(ftr(im,j).μtr(im,j))</p>
<p>This Equation leads to a support vector for each l, ftr( im, j)e .</p>
<p>While testing to find the label of a teFV, we will invoke the HT divergence. As we don’t have statistics governing the teFV, we will use the statistical parameters (i.e., mean and variance) of tFVs to compute MF, μte(j) of a teFV. To make it compatible with μtr, the test MF is updated w.r.t. each support vector of class l from:</p>
<p>−(ftr(im,j).μtr(im,j))</p>
<p>μ ̂te(j) = μte(j){e |l, (25)</p>
<p>with the help of μ ̂te(j), we can frame the HT divergence as:</p>
<p>H −(ftr(im,j).μtr(im,j)) −(fte(j).μ ̂te(j))</p>
<p>H∆T(l) = ∑ ftr( im, j){e |l − e }.</p>
<p>(26)</p>
<p>The identity (Id) of the unknown class is found by determining the infimum out of all classes from:</p>
<p>Id = Infl{H∆T(l)}. (27) Approach 2 (With learning). As we had both FVs and MF vectors, there was no need for a learning model in the above classifier. But to see the power of the learning model, we shall introduce a power β on ftr( i, j) and initialize its values randomly. We create as many values as the number of tFVs of a class and form an effort vector. We aim to find the support vector of each class for learning β. So, we compute the uncertainty representation of each tFV of the lth class using the HT divergence as:</p>
<p>β −(f (j).μte(j)) H −(ftr(i,j).μtr(i,j)) te</p>
<p>H∆T(i, l) = ∑ f ( i, j){e |l − e }.</p>
<p>tr (28)</p>
<p>Let H∆T(i, l) be considered as the fitness/outcome value, f(t, k, le), where t denotes the iteration; k denotes the ith contender, and le denotes the effort/weight vector. We invoke the learning model by providing it a set of fitness values and effort vectors. The learning model delivers the minimum value of H∆T(im, l) for the index im from tFV. Next, identifying the class label of teFV using Eqs. (25)-(27) is a cake walk based on the HT divergence.</p>
</sec>
<sec id="sec-13"><label>5.2</label><title>The Design of A Forecaster</title>
<p>Forecasting is an important problem in many applications such as forecasting of weather, demand, rain, stock market, election, etc. In this work, we address this problem under the framework of information set theory. For simplicity, we consider two categories of variables: endogenous and exogenous. Both of these types may refer to any quantities depending on an application. We would like to adopt the window-based approach in which we fix the time slot that could be a month, a year, or several years. In this time slot, the data is procured either day-wise or week-wise, and consideration of the lead time varies accordingly. Let us denote Iy as an independent or endogenous variable and Ix as an external or exogenous variable. The past values of these variables are assumed to form fuzzy sets. Let Hy be the information set of endogenous variables Iy, and Hx1, Hx2,.., Hxq be the information sets of exogenous variables Ix1, Ix2,.., Ixq respectively. These variables take mostly real values, but a few of them may have truth/binary values; then we consider their probabilities. To represent the past values, an integer of 1 is subtracted from an instant, k. The number of past values to be considered for each exogenous variable depends on how much influence it has on the endogenous variable. To determine this dependency, one way is to perform correlation analysis between the endogenous variable and the exogenous variables. The choice of the number of past values of the endogenous variable can be determined by performing clustering on the values of the endogenous variable or can be arrived at by a trial-and-error process. Alternatively, we can also go in for the structure determination approaches of fuzzy modeling. In the present study, we intend to develop an information set-based regression model linking an endogenous variable with the exogenous variables.</p>
<p>The proposed regression model gives a relation between the present endogenous value and the past information of values of the endogenous and the exogenous variables. This model is mathematically expressed as:</p>
<p>ly lx lx H H H</p>
<p>yf(k/k − l) = ∑ wy. Hy (k − l) + ∑ wx1. Hx1 (k − l) + ∑ wx2. Hx2 (k − l) + ⋯</p>
<p>l l l</p>
<p>lx (29)</p>
<p>+ ∑ wxq. Hxq (k − l),</p>
<p>where the information values are taken as Hy (k − l) = Iy(k − l). μy(k − l) and Hxi(k − l) = Ixi(k − l). μxi(k − l). The MFs are assumed to be triangular or trapezoidal. We can also use pMF to improve the regression model. The unknown weight parameters in Eq. (29) are learned using OLM. In case the forecasting error is to be utilized as another exogenous variable, it can be included as an additional term in the model, shown as under:</p>
<p>Iyf(k + 1/k) = Iyf(k/k − 1) + we. ef(k/k − 1),</p>
<p>(30)</p>
<p>where ef(k/k − 1) = Iy(k) − Iyf(k/k − 1).</p>
<p>In this context, development of the information set-based regression model can be seen in <xref ref-type="bibr" rid="ref-18">[17]</xref>.</p>
</sec>
<sec id="sec-14"><label>5.3</label><title>The Design of Generative-Adversarial Network Using DeepInfoNet</title>
<p>The concepts of EB-OLM can be easily ported to deep learning neural networks in creating new architectures from them. We have already made a step in this direction by creating HanmanNets through the modification of ResNet <xref ref-type="bibr" rid="ref-19">[18]</xref>. Inspired by this work, DeepInfoNet is evolved from two handcrafted Convolutional Neural Networks (CNNs). We intend to design the information set-based GAN architecture using DeepInfoNet. A brief description of this net is as follows: the specialty of DeepInfoNet is that it is built block-wise with the scaffolding of two convolutional layers and one pooling layer in every block. A specific number of kernels /filters of size 3x3 is engaged in a convolutional layer, whereas a stride of 2x2 is made in the max-pooling layer. Each kernel performs a convolution operation on an input image, and this is followed by batch normalization.</p>
<p>The features extracted from feature maps of the first block are examined first. If they fail to meet the requisite classification accuracies, then these features are concatenated with those from the feature maps of the second block for the purpose of reevaluation. If the concatenated features succumb to the same fate, accessing the feature maps of the third block is the last and final recourse.</p>
<p>Let us allot one network for the generator DeepInfoNet catering to the training and another for the adversary DeepInfoNet catering to the testing. A kernel function convolving with the input image at every pixel location incarnates into an MF matrix. Let NF denote the number of feature maps, also referring to the number of kernels/filters, and xy, a pixel location in a feature map. The pixel intensity in a feature map μ′xy is designated as the MF, whereas μ′n,xy is the nMF, with both having the superscript apostrophe (&apos;). Resizing of the input image Ixy to that of the feature map makes it appear as Ixy. The conglomeration of the pixel intensities from all feature maps at a location xy gives rise to MF as μ′xy,j and to nMF as μ′nxy,j , j=1 to NF.</p>
<p>To show how to generate ftr(i, j) and fte(i, j) in the context of GAN, we define the MH intuitionistic fuzzy entropy function as:</p>
<p>1 α β α β</p>
<p>MH γ −(c1(.)μ +d1(.)) γ −(c2(.)μ +d2(.))</p>
<p>xy n,xy</p>
<p>HF = ∑ ∑ μxye + μn,xye .</p>
<p>2 (31)</p>
<p>x=1 y=1</p>
<p>First of all, we set β = γ and α = 1 in Eq. (31), and this substitution leads to:</p>
<p>1 γ γ</p>
<p>MH γ −(c1(.)μ +d1(.)) γ −(c2(.)μ +d2(.))</p>
<p>xy n,xy</p>
<p>HF = ∑ ∑ μxye + μn,xye .</p>
<p>2 (32)</p>
<p>x=1 y=1</p>
<p>We derive two functions; the first one with different gain functions while the second one with the same gain functions. For the first one, the substitution is: c1(.)=c2(.)=1 and d1(.)=d2(.)=0 and but for the second one, c1(. ) = μn,xy and c2(. ) = μxy with d1(.)=d2(.)=0. The resulting intuitionistic fuzzy functions are:</p>
<p>1 γ γ</p>
<p>MH γ −μ γ −μ</p>
<p>xy n,xy</p>
<p>HF1 = ∑ ∑ {μxye + μn,xye } ,</p>
<p>2 (33)</p>
<p>x=1 y=1 MH γ −(μ μ ))</p>
<p>xy n,xy</p>
<p>HF2 = ∑ ∑ {Pxy e , }</p>
<p>2 (34)</p>
<p>x=1 y=1</p>
<p>γ γ γ</p>
<p>where Pxy = μxy + μn,xy. The bracketed terms can also be called the embedded MFs. To reflect that the below are derived from the feature maps, we place an apostrophe on all the functions:</p>
<p>NF NF</p>
<p>1 ′γ ′γ</p>
<p>′MH ′γ −μ γ −μ</p>
<p>xy n,xy</p>
<p>HF1 = ∑ ∑ {μxye + μ′n,xye } , (35)</p>
<p>NF</p>
<p>x=1 y=1 NF NF</p>
<p>1 ′ ′ γ</p>
<p>′MH ′γ −(μ μ ))</p>
<p>xy n,xy</p>
<p>HF2 = ∑ ∑ {Pxy e }. (36)</p>
<p>NF</p>
<p>x=1 y=1</p>
<p>′ ′MH ′MH</p>
<p>In moving from a fuzzy set to an intuitionistic fuzzy set, μxy gains the bracketed terms (HF1,xy and HF2,xy), and this is the handiwork of the Intuitionistic MH fuzzy entropy function that has imparted structures to it. Let Ixy be the input image with its size reduced to that of the MF matrix. The information values could be of</p>
<p>′ ′ ′ ′MH ′ ′MH</p>
<p>three kinds: Ixyμxy, IxyHF1,xy and IxyHF2,xy. We can choose any one of these as the DeepInfoNet feature, as they are tapped from the feature map of this architecture.</p>
<p>For validation, the training and test sets have to be separated, and the corresponding DeepInfoNet feature sets are assigned to Gen and Adv, which stand for the Generator and Adversary modules of GAN. So, we can designate DeepInfoNet as GAN-DeepInfoNet or simply GAN-InfoNet and name its modules as Gen-InfoNet to deal with ftr(i, j) and similarly Adv-InfoNet, to deal with fte(j). The FVs and MFs involved in the GAN-InfoNets are elaborated as:</p>
<p>′i ′</p>
<p>ftr(i, j) = Itr,xy; fte(j) = Ite,xy.</p>
<p>′i ′i,MH ′i,MH ′ ′ MH ′ MH th</p>
<p>μtr(i, j) = {μtr,xy, H , H } and μte(j) = {μte,xy, HFte1,xy, HFte2,xy), where we have denoted the i IS</p>
<p>Ftr1,xy Ftr2,xy</p>
<p>vector and MF vector by the superscript, i and j correspond to xy. We have to make sure that the tFVs of each class must be separated out. It is now imperative to make an analogy with the classifier above in assigning the roles to the two modules. The task of Gen-Net is to determine the support vector of each class using Eq. (36), and that of Adv-Net is to use the support vectors furnished by the Gen-Net and apply the criterion function to find the class label of the tFV using Eqs, (25) to (27). The value of γ is a design parameter, chosen to be less than 1 by trial-and-error till we achieve the desired performance. Here the services of the learning model are no longer needed.</p>
<p>If γ is to be learned, we go in for the learning model by adopting the procedure outlined above. Here, γ replaces β, all other things remaining the same. This GAN-InfoNet is designed to act as a classifier, and depending on the application, we can alter its architecture.</p>
</sec>
<sec id="sec-15"><label>5.4</label><title>The Rough Information Sets</title>
<p>Along the lines of rough fuzzy sets, we would like to create rough information sets. The concept of a rough fuzzy set is very useful if the IS/attribute values display two different distributions. In the analysis of a texture image, we can carve out both the smooth and rough constituents by decomposing it into an approximation image (i.e., smooth) and the composite image (i.e., rough) from it. The composite image is constructed from the diagonal and off-diagonal sub-bands arising from decomposition. It is easy to infer that by applying DeepInfoNet on these images, we can get the two types of MF matrices from the respective feature maps representing smooth and rough distributions. These, along with the pixel intensities of the reduced input images, help generate smooth-DeepInfoNet and rough-DeepInfoNet features.</p>
<p>The MF, μ′n,xy and the nMF, μ′n,xy function values belong to the smooth and rough MF values, respectively, with γ acting as a roughness factor. The correct choice of γ is very important for the delineation of smooth and rough MF values. The resulting information values formed from both the smooth and rough values constitute rough information sets. The roughness factor delineated as the ratio of smooth certainty information divided by the rough certainty information is given by:</p>
<p>n1 n1 ′ ′γ</p>
<p>∑x=1 ∑y=1 Is,xyμxy</p>
<p>RF = γ . (37)</p>
<p>n2 n2 ′</p>
<p>∑x=1 ∑y=1 Ir,xyμ′</p>
<p>n,xy</p>
</sec>
<sec id="sec-16"><label>5.5</label><title>The Other Possible Applications</title>
<p>In addition to the two case studies in the medical domain, some of the applications of the EB-OLM could focus on different types of forecasting like weather, stock market, sales, etc. It can be applied to solve industrial problems such as decision-making, identification of fake news, recommender systems, cybersecurity, sentiment analysis, etc. The miscellaneous applications include areas of Biometrics, Image processing, and pattern recognition.</p>
<p>We can also cash in on the learning abilities of EDOY and EROY in the design of classifiers for the classification of deep information set features extracted from the feature maps of any deep learning neural network architecture by assigning the roles of objective functions to the transforms, i.e., high-level entropy functions used for the uncertainty representation of features.</p>
</sec>
</sec>
<sec id="sec-17"><label>6</label><title>Results of Implementation of Effort-Based Outlook Learning Models</title>
<sec id="sec-18"><label>6.1</label><title>A Comparison of Effort-Based Outlook Learning Models with Other Meta-Heuristic Techniques</title>
<p>This comparison is undertaken on the following benchmark functions for optimization to learn their parameters:</p>
<p>I. Powell function f1(x).</p>
<p>II. Rosenbrock function f2(x).</p>
<p>III. Dixon and Prince function f3(x).</p>
<p>IV. Schwefe126 function f4(x).</p>
<p>V. Rastrigin function f5(x).</p>
<p>VI. Griewank function f6(x).</p>
<p>VII. Qing function f7(x).</p>
<p>VIII. Alpine01 function f8(x).</p>
<p>IX. Ackleley function f9(x).</p>
<p>X. Perm function f10(x).</p>
<p>All these functions have the same global minimum of zero. The different metaheuristic techniques chosen for comparison are: Whale Optimization Algorithm (WOA), Artificial Fish Swarm Algorithm (AFSA), Krill Herd (KH), HEFAG <xref ref-type="bibr" rid="ref-5">[4]</xref>, CCLM <xref ref-type="bibr" rid="ref-6">[5]</xref>, Black Widow Optimization (BWO), Red Deer Algorithm (RDA), and Sandpiper algorithm. Here, we have not considered the Genetic Algorithm (GA) for comparison, as it requires several parameters such as the number of chromosomes, fitness function, population size, crossover and mutation operators, and the number of iterations. The correct choice of these parameters is fraught with many difficulties. In contrast, in the proposed learning model, the population size (i.e., the number of contenders) is set to 30. <xref ref-type="table" rid="tab1">Table 1</xref> shows the results of optimization obtained with the meta-heuristic techniques on 10 benchmark functions having 50 parameters each. We have carried out 24 runs, and each run has 1000 iterations. We have also computed the mean, standard deviation, and the median over the 24 runs. As can be noticed from this table, the EB-OLM surpasses other meta-heuristic techniques after convergence is attained. <xref ref-type="fig" rid="fig1">Figs. 1</xref>-3 show the implementation of different meta-heuristic techniques like EB-OLM, WOA, LOA, GBC, and RDA on Powell, Rastrigin, and Grievank functions, respectively. It is clear from these figures that the values of these functions converge to zero with EB-OLM.</p>
<p>To showcase EB-OLM, the two real-life applications taken up include: 1) detection of retinal diseases from retinal images, and 2) prediction of heart diseases from ECGs of patients.</p>
<fig id="fig1"><label>Figure 1</label><caption><p>A comparison of different meta-heuristic techniques.</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/57/fig-1-a8de4019dbff.png"/></fig>
<fig id="fig2"><label>Figure 2</label><caption><p>Comparison of different meta-heuristic techniques on Powell function (dim.=40).</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/57/fig-2-522e2573227e.png"/></fig>
<fig id="fig3"><label>Figure 3</label><caption><p>Comparison of different meta-heuristic techniques on Rastrigin function (dim.=40).</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/57/fig-3-f1ef1da56ab9.png"/></fig>
<fig id="fig4"><label>Figure 4</label><caption><p>Comparison of different meta-heuristic techniques on Griewank function (dim.=40).</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/57/fig-4-f42f6850ce68.png"/></fig>
<p>Case Study 1 (Detection of retinal diseases). The retinal images are of high resolution, captured under a variety of imaging conditions. A clinician rates the presence of Diabetic Retinopathy (DR) in an image on a scale of 0 to 4, with the following categories/classes: 0 - No DR, 1 – Mild DR, 2– Moderate DR, 3 –Severe DR, and 4 - Proliferative DR. A total of 88, 702 images exists and out of these 54,000 are set aside for the training and the rest for the testing. A typical retinal image for each category of DR is shown in <xref ref-type="fig" rid="fig5">Fig. 5</xref>. In this study, the probabilistic feature called the hybrid Hanman-Rényi-Tsallis transform derived in <xref ref-type="bibr" rid="ref-17">[16]</xref> is found to be most suitable, as under:</p>
<fig id="fig5"><label>Figure 5</label><caption><p>DR images; a. Mild DR, b. Moderate DR, c. Severe DR, and d. Proliferative DR.</p></caption><graphic xlink:href="https://maa.reapress.com/public/journals/1/jats-figures/57/fig-5-476835931c54.jpg"/></fig>
<p>HRT .α.log(Px)/(1−α) (Px−Px )/(α−1)</p>
<p>Hk = ∑ Px{e + e }, (38)</p>
<p>where , the probability of the pixel intensity is computed from the histogram of a window in a retinal image, and α is set at 1.6. The size of the window is selected as 15x15 after experimentation. While learning the parameter β of the classifier using EB-OLM, the population size is fixed at 40 and the number of runs at 24. Within each run, 1000 iterations are executed. The widely used classifiers like Random Forest (RF), CNN, Naïve Bayes classifier, and K-Nearest Neighbour are compared in <xref ref-type="table" rid="tab2">Table 2</xref> for the detection of DR.</p>
<p>The proposed classifier is shown to outperform the well-known classifiers compared. As evident from <xref ref-type="table" rid="tab2">Table 2</xref>, the proposed methodology gives an accuracy of 97.5% and outperforms other classifiers.</p>
<table-wrap id="tab1"><label>Table 1</label><caption><p>Comparison of the performance of different classifiers.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:16:66,371.1,537.1,451.3"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>Case Study 2 (Prediction of heart diseases). The status of a heart, whether it is healthy or defective, is dealt with in <xref ref-type="bibr" rid="ref-20">[19]</xref>. The 13 attributes in the heart dataset include: age, sex, cp: chest pain type; trestbps: resting blood pressure; chol: serum cholesterol; fbs: fasting blood pressure; restecg: resting electrocardiographic results; thalach: maximum heart rate; exang: exercise-induced angina; oldpeak: ST depression induced by an exercise relative to the resting; slope: the slope of the peak exercise ST segment; ca: number of major vessels colored by fluoroscopy; thal: thalassemia.</p>
<p>In this dataset, the variables such as sex, fbs, rest ecg, and exang are binary, whereas slope takes values (0, 1,2), and the variables cp, ca, and thal take integer values (0, 1, 2, 3). So we find the probability of each integer variable separately and then compute the probabilistic uncertainty using the Hanman-Tsallis transform <xref ref-type="bibr" rid="ref-18">[17]</xref>, given by:</p>
<p>HTs (Px−Px )/(α−1)</p>
<p>Hx = Pxe . (39)</p>
<p>This Equation is derived from the Tsallis entropy function <xref ref-type="bibr" rid="ref-21">[20]</xref>, defined as:</p>
<p>n n α</p>
<p>∑i=1 pxi − ∑i=1 pxi</p>
<p>H = . (40)</p>
<p>α − 1</p>
<p>One term on the r.h.s. of Eq. (40) can be written as:</p>
<p>pxi − pxi</p>
<p>Hx = . (41)</p>
<p>α − 1</p>
<p>Using Hx as the exponential gain function of HT leads to the Hanman-Tsallis transform in Eq. (39).</p>
<p>The variables age, trestbps, chol, thalach, and oldpeak are considered as features denoted by Qx where x stands for each of these variables numbering q=13; hence we fit the Gaussian MF, μx by computing the mean and variance of the distribution underlying each feature. Here, we make use of the possibilistic Rényi entropy</p>
<p>(1−Qx)</p>
<p>function, μ ̅̅̅ xe derived by Bhatia and Hanmandlu <xref ref-type="bibr" rid="ref-22">[21]</xref> from the probabilistic Rényi entropy function <xref ref-type="bibr" rid="ref-23">[22]</xref>. As the sigmoid function representing the uncertainty in the distribution/variation of each feature is found to be more effective than the possibilistic entropy function, it is given by:</p>
<p>RS</p>
<p>Hx = , (42)</p>
<p>−̅ μ ̅̅̅e(1−Qx)</p>
<p>1 + e x</p>
<p>where μ ̅̅̅ x is its complement MF. The weights (i.e., efforts) to be learned are those of 13 features.</p>
<p>Implementation aspects: before implementing the prediction using Eq. (41), we need to initialize all the weights with random values. Taking each sample at a time, we have to plug in the information values of features. If a feature is an integer, we have to get its probabilistic uncertainty, but if it is real, then its possibility certainty. Using the initial weights and the information values, the output is computed. By invoking EB-OLM, we get the updated values of the weights. In the next iteration, the computed output is considered as the 14th feature, and then it is weighted to serve as an additional input to improve prediction, thus making the number of weights equal to 14. The output weight is assumed to be a random number. This procedure is repeated until all the training samples are utilized. Table 3 gives a comparison of our methodology with literature detectors on the prediction of heart diseases and outperforms other classifiers.</p>
<table-wrap id="tab2"><label>Table 2</label><caption><p>Comparison of the performance of different classifiers.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:17:66,387.8,537.1,468"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
<p>We now take a respite to deliberate on the contributions made in this paper. These include: 1) formulation of three efforts-based learning models, 2) development of design models for classifier, predictor, and GAN architecture, and 3) Presentation of two case studies for the vindication of the certainty/uncertainty representation.</p>
</sec>
</sec>
<sec id="sec-19"><label>7</label><title>Conclusions</title>
<p>This paper introduces the concept of Efforts-Based Outlook (EBO) by proposing the three types of efforts, viz., ENO, ERO, and ESO, to be associated with the three kinds of outlooks. We have tried to devise a learning model for each kind of outlook. A contender for success attempting to achieve a goal can be in any one of three outlooks, viz., ENOY, EROY, and ESOY, depending on the type of efforts employed by the contender. ENOY does not expect anything from the outcome of his/her efforts but uses it to improve his/her performance. EROY competes with the best performer, aiming at better fruits, as attaining excellence is the motto. ESOY tries to steal the outcome of others’ efforts. Thus, this work has cashed in on one form of human behaviour, but there are several manifestations of behavioural forms that come into play when other endeavours are considered.</p>
<p>The entire modelling is done at the backdrop of the information set theory, in which we have exploited both the basic and higher-level certainty representation through the information sets. As ENOY solely depends on efforts to achieve a goal, we have used an advanced pervasive information set in modelling this component of outlook learning. EROY has a competitive spirit to excel others, and the HT divergence is poised to be adept for modelling this component of learning. An ESOY eyes the outcome of others’ efforts, and to model this component of learning, we have used the basic information but with an appropriate modification. The EB-OLM is compared with WOA, LOA, GBC and RDA for the optimization of three standard functions such as Powell, Rastrigin and Grievank functions. The fastest convergence to the correct parameter values is achieved with the EB-OLM.</p>
<p>We have attempted the design of both classifier and predictor under the aegis of the certainty/uncertainty representation and learned their parameters with the help of EB-OLM. Some applications of EB-OLM, classifier, and predictor are suggested for future work. We have also given the formulation for the design of a Generative-Adversarial network using the handcrafted deep learning network architecture called DeepInfoNet and suggested how to create rough information sets. These applications emanate from the utilitarian aspects of the EBO learning. These developments are the only beginning of the journey, and their outreach can pave the way for solutions to many problems.</p>
<p>Two case studies comprising DR and heart disease prediction are showcased to demonstrate the power of the designs of the classifier and the predictor, respectively, with the aid of the proposed EB-OLM, and their performance is shown to exceed that of the classical classifiers. The versatility of three modes of learning can be utilized in framing different architectures for deep learning neural networks, thereby opening a gateway to the benefits of the information set theory that underlies the learning models.</p>
<p>Lastly, it may be noted that the learning components of outlook differ as per the types of efforts displayed while accomplishing an activity related to achieving a goal. Hence. the three kinds of effort-based outlook learning models are shown to outperform other approaches in two case studies.</p>
<p>As regards the shortcomings of the learning models, selection of the population size and fixation of the number of iterations are critical for the convergence of the parameters to be learned.</p>
<p>The learning models, case studies, and the design of classifiers and predictors show the versatility of information set theory. However, the formulations of GAN and rough information sets are not implemented, and we are in search of suitable applications to validate them. The future work is to embark on the development of information set-based Large Language Models (LLMs) in the context of querying and reasoning.</p>
</sec>
<sec id="sec-20"><title>Authors&apos; Contributions</title>
<p>All aspects of the research and manuscript preparation were carried out by the author. The author has read and approved the final version of the manuscript.</p>
</sec>
<sec id="sec-21"><title>Funding</title>
<p>Not applicable.</p>
</sec>
<sec id="sec-22"><title>Data Availability</title>
<p>All data supporting the reported findings in this research paper are provided within the manuscript.</p>
</sec>
<sec id="sec-23"><title>Conflict of Interest</title>
<p>The author declares that they do not have any conflict of interest.</p>
</sec>
<sec id="sec-24"><title>Consent for Publication</title>
<p>The author confirms consent for the publication of this work</p>
</sec>
<sec id="sec-25"><title>Ethics Approval and Consent to Participate</title>
<p>This article does not contain any studies with human participants performed by the author.</p>
</sec>
</body>
<back><ref-list><title>References</title>
<ref id="ref-1"><label>1</label><mixed-citation>Rao, R. V., Savsani, V. J., &amp; Vakharia, D. P. (2011). Teaching-learning-based optimization: A novel method for constrained mechanical design optimization problems. Computer-aided design, 43(3), 303–315. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.cad.2010.12.015">https://doi.org/10.1016/j.cad.2010.12.015</ext-link></mixed-citation></ref>
<ref id="ref-2"><label>2</label><mixed-citation>Rao, R., &amp; others. (2016). Jaya: A simple and new optimization algorithm for solving constrained and unconstrained optimization problems. International journal of industrial engineering computations, 7(1), 19–</mixed-citation></ref>
<ref id="ref-3"><label>34</label><mixed-citation><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5267/j.ijiec.2015.8.004">https://doi.org/10.5267/j.ijiec.2015.8.004</ext-link></mixed-citation></ref>
<ref id="ref-4"><label>3</label><mixed-citation>Rao, R. V. (2020). Rao algorithms: Three metaphor-less simple algorithms for solving optimization problems. International journal of industrial engineering computations, 11(1), 107-130. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5267/j.ijiec.2019.6.002">https://doi.org/10.5267/j.ijiec.2019.6.002</ext-link></mixed-citation></ref>
<ref id="ref-5"><label>4</label><mixed-citation>Grover, J., &amp; Hanmandlu, M. (2018). New evolutionary optimization method based on information sets. Applied intelligence, 48(10), 3394–3410. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s10489-018-1154-x">https://doi.org/10.1007/s10489-018-1154-x</ext-link></mixed-citation></ref>
<ref id="ref-6"><label>5</label><mixed-citation>Grover, J., &amp; Hanmandlu, M. (2021). Novel competitive-cooperative learning models (CCLMs) based on higher order information sets. Applied intelligence, 51(3), 1513–1530. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s10489-020-01881-3">https://doi.org/10.1007/s10489-020-01881-3</ext-link></mixed-citation></ref>
<ref id="ref-7"><label>6</label><mixed-citation>Grover, J., &amp; Hanmandlu, M. (2021). Development of an optimal entropy classifier and prudent learning model. IEEE transactions on artificial intelligence, 3(2), 164–175. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/TAI.2021.3117491">https://doi.org/10.1109/TAI.2021.3117491</ext-link></mixed-citation></ref>
<ref id="ref-8"><label>7</label><mixed-citation>Hanmandlu, M., &amp; Das, A. (2011). Content-based image retrieval by information theoretic measure. Defence science journal, 61(5), 415–430. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.14429/dsj.61.1177">https://doi.org/10.14429/dsj.61.1177</ext-link></mixed-citation></ref>
<ref id="ref-9"><label>8</label><mixed-citation>Pal, N. R., &amp; Pal, S. K. (1991). Entropy: A new definition and its applications. IEEE transactions on systems, man, and cybernetics, 21(5), 1260–1270. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/21.120079">https://doi.org/10.1109/21.120079</ext-link></mixed-citation></ref>
<ref id="ref-10"><label>9</label><mixed-citation>Hanmandlu, M., &amp; others. (2014). A new entropy function and a classifier for thermal face recognition. Engineering applications of artificial intelligence, 36, 269–286. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.engappai.2014.06.028">https://doi.org/10.1016/j.engappai.2014.06.028</ext-link></mixed-citation></ref>
<ref id="ref-11"><label>10</label><mixed-citation>Aggarwal, M., &amp; Hanmandlu, M. (2015). Representing uncertainty with information sets. IEEE transactions on fuzzy systems, 24(1), 1–15. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/TFUZZ.2015.2417593">https://doi.org/10.1109/TFUZZ.2015.2417593</ext-link></mixed-citation></ref>
<ref id="ref-12"><label>11</label><mixed-citation>Hanmandlu, M., Bansal, M., &amp; Vasikarla, S. (2020). An introduction to information sets with an application to iris based authentication. Journal of modern physics, 11(1), 122–144. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4236/jmp.2020.111008">https://doi.org/10.4236/jmp.2020.111008</ext-link></mixed-citation></ref>
<ref id="ref-13"><label>12</label><mixed-citation>Sayeed, F., &amp; Hanmandlu, M. (2017). Properties of information sets and information processing with an application to face recognition. Knowledge and information systems, 52(2), 485–507. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s10115-016-1017-x">https://doi.org/10.1007/s10115-016-1017-x</ext-link></mixed-citation></ref>
<ref id="ref-14"><label>13</label><mixed-citation>Hanmandlu, M., &amp; Singhal, S. (2017). Face recognition under pose and illumination variations using the combination of information set and PLPP features. Applied soft computing, 53, 396–406. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.asoc.2017.01.014">https://doi.org/10.1016/j.asoc.2017.01.014</ext-link></mixed-citation></ref>
<ref id="ref-15"><label>14</label><mixed-citation>Atanassov, K. T. (1999). Intuitionistic fuzzy sets. In Intuitionistic fuzzy sets: Theory and applications (pp. 1– 137). Springer. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/978-3-7908-1870-3_1">https://doi.org/10.1007/978-3-7908-1870-3_1</ext-link></mixed-citation></ref>
<ref id="ref-16"><label>15</label><mixed-citation>Ansari, F., &amp; Madasu, H. (2024). Color thresholding detection and recognition of the road signs using the information set theory. Journal of modern physics, 15(11), 1646–1678. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4236/jmp.2024.1511072">https://doi.org/10.4236/jmp.2024.1511072</ext-link></mixed-citation></ref>
<ref id="ref-17"><label>16</label><mixed-citation>Asthana, P., Hanmandlu, M., &amp; Vashisth, S. (2022). Classification of brain tumor from magnetic resonance images using probabilistic features and possibilistic Hanman-Shannon transform classifier. International journal of imaging systems and technology, 32(1), 280–294. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1002/ima.22619">https://doi.org/10.1002/ima.22619</ext-link></mixed-citation></ref>
<ref id="ref-18"><label>17</label><mixed-citation>Asthana, P., Hanmandlu, M., &amp; Vashisth, S. (2022). Brain tumor detection and patient survival prediction using U-Net and regression model. International journal of imaging systems and technology, 32(5), 1801–1814. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1002/ima.22735">https://doi.org/10.1002/ima.22735</ext-link></mixed-citation></ref>
<ref id="ref-19"><label>18</label><mixed-citation>Dabass, J., Hanmandlu, M., Vig, R., &amp; Vasikarla, S. (2024). Mammogram classification with HanmanNets using hanman transform classifier. Journal of modern physics, 15(7), 1045–1067. <ext-link ext-link-type="uri" xlink:href="https://ui.adsabs.harvard.edu/link_gateway/2024JMPh...15.1045D/doi:10.4236/jmp.2024.157045">https://ui.adsabs.harvard.edu/link_gateway/2024JMPh...15.1045D/doi:10.4236/jmp.2024.157045</ext-link></mixed-citation></ref>
<ref id="ref-20"><label>19</label><mixed-citation>Chellammal, S., &amp; Sharmila, R. (2019). Recommendation of attributes for heart disease prediction using correlation measure. International journal of recent technology and engineering (IJRTE), 8(23), 870–875. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.35940/ijrte.B1163.0782S319">https://doi.org/10.35940/ijrte.B1163.0782S319</ext-link></mixed-citation></ref>
<ref id="ref-21"><label>20</label><mixed-citation>Tsallis, C., Mendes, R., &amp; Plastino, A. R. (1998). The role of constraints within generalized nonextensive statistics. Physica a: Statistical mechanics and its applications, 261(3–4), 534–554. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/S0378-4371(98)00437-3">https://doi.org/10.1016/S0378-4371(98)00437-3</ext-link></mixed-citation></ref>
<ref id="ref-22"><label>21</label><mixed-citation>Bhatia, A., &amp; Hanmandlu, M. (2018). Keystroke dynamics based authentication using possibilistic Rényi entropy features and composite fuzzy classifier. Journal of modern physics, 9(02), 112. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4236/jmp.2018.92008">https://doi.org/10.4236/jmp.2018.92008</ext-link></mixed-citation></ref>
<ref id="ref-23"><label>22</label><mixed-citation>Rényi, A. (1961). On measures of entropy and information. In Proceedings of the fourth Berkeley symposium on mathematical statistics and probability, volume 1: Contributions to the theory of statistics (Vol. 4, pp. 547- 562). University of California Press. <ext-link ext-link-type="uri" xlink:href="https://projecteuclid.org/ebook/Download?urlid=bsmsp/1200512181&amp;isFullBook=false">https://projecteuclid.org/ebook/Download?urlid=bsmsp/1200512181&amp;isFullBook=false</ext-link></mixed-citation></ref>
</ref-list></back>
</article>