title: Variance Reduction for Matrix Computations with Applications to Gaussian Processes

abstract: In addition to recent developments in computing speed and memory, methodological advances have contributed to significant gains in the performance of stochastic simulation. In this paper, we focus on variance reduction for matrix computations via matrix factorization. We provide insights into existing variance reduction methods for estimating the entries of large matrices. Popular methods do not exploit the reduction in variance that is possible when the matrix is factorized. We show how computing the square root factorization of the matrix can achieve in some important cases arbitrarily better stochastic performance. In addition, we propose a factorized estimator for the trace of a product of matrices and numerically demonstrate that the estimator can be up to 1,000 times more efficient on certain problems of estimating the log-likelihood of a Gaussian process. Additionally, we provide a new estimator of the log-determinant of a positive semi-definite matrix where the log-determinant is treated as a normalizing constant of a probability density.


title: Modeling and Reasoning in Event Calculus using Goal-Directed Constraint Answer Set Programming

abstract: Automated commonsense reasoning is essential for building human-like AI systems featuring, for example, explainable AI. Event Calculus (EC) is a family of formalisms that model commonsense reasoning with a sound, logical basis. Previous attempts to mechanize reasoning using EC faced difficulties in the treatment of the continuous change in dense domains (e.g., time and other physical quantities), constraints among variables, default negation, and the uniform application of different inference methods, among others. We propose the use of s(CASP), a query-driven, top-down execution model for Predicate Answer Set Programming with Constraints, to model and reason using EC. We show how EC scenarios can be naturally and directly encoded in s(CASP) and how it enables deductive and abductive reasoning tasks in domains featuring constraints involving both dense time and dense fluents.


title: SARiSsa -- A Mobile Application for the Proactive Control of SARS-CoV-2 Spread

abstract: In this work we propose the design principles behind the development of a smart application utilized by mobile devices in order to control the spread of SARS-CoV-2 coronavirus disease that caused the COVID-19 pandemic. Through the deployment of this application utilizing their Bluetooth enabled devices, individuals may keep track of their close contacts, and if nearby contacts using the same application are reported later as infected the proximate individual is informed in order to be quarantined for a short of time, preventing hence the spread of the virus. Through the latest year, there have been developed several applications in the Google Play Store that can be deployed by smart devices utilizing their Bluetooth connectivity for the nearby device tracking. However, in this work we propose an open architecture for the development of such applications, that also incorporates a more elaborated graph-theoretic and algorithmic background regarding the contact tracing. The proposed contact tracing algorithm, that can be embedded in the deployment of the application, provides a more immediate tracking of the contacts of an infected individuals, providing a wider extent in the tracing of the contacts, leading hence to a more immediate mitigation of the epidemic.


title: Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity

abstract: The success of deep ensembles on improving predictive performance, uncertainty estimation, and out-of-distribution robustness has been extensively studied in the machine learning literature. Albeit the promising results, naively training multiple deep neural networks and combining their predictions at inference leads to prohibitive computational costs and memory requirements. Recently proposed efficient ensemble approaches reach the performance of the traditional deep ensembles with significantly lower costs. However, the training resources required by these approaches are still at least the same as training a single dense model. In this work, we draw a unique connection between sparse neural network training and deep ensembles, yielding a novel efficient ensemble learning framework called FreeTickets. Instead of training multiple dense networks and averaging them, we directly train sparse subnetworks from scratch and extract diverse yet accurate subnetworks during this efficient, sparse-to-sparse training. Our framework, FreeTickets, is defined as the ensemble of these relatively cheap sparse subnetworks. Despite being an ensemble method, FreeTickets has even fewer parameters and training FLOPs than a single dense model. This seemingly counter-intuitive outcome is due to the ultra training/inference efficiency of dynamic sparse training. FreeTickets surpasses the dense baseline in all the following criteria: prediction accuracy, uncertainty estimation, out-of-distribution (OoD) robustness, as well as efficiency for both training and inference. Impressively, FreeTickets outperforms the naive deep ensemble with ResNet50 on ImageNet using around only 1/5 of the training FLOPs required by the latter. We have released our source code at https://github.com/VITA-Group/FreeTickets.


title: On non-linear optimization with a perturbed objective function

abstract: A Lagrange multiplier theorem is derived for the case of an imprecise objective function and a precise constraint. The proof uses methods of analysis which deal in a direct, algebraic way with imprecisions. They include imprecise differentiation, and an approximate Fermat Lemma and Implicit Function Theorem. The tools are the external numbers of Nonstandard Analysis, which are models of Sorites imprecisions.


title: Topological phase transitions in 2-dimensional bent-core liquid crystal models

abstract: Spontaneous onset of a low temperature topologically ordered phase in a 2-dimensional (2D) lattice model of uniaxial liquid crystal (LC) was debated extensively pointing to a suspected underlying mechanism affecting the RG flow near the topological fixed point. A recent MC study clarified that a prior crossover leads to a transition to nematic phase. The crossover was interpreted as due to the onset of a perturbing relevant scaling field originating from the extra spin degree of freedom. As a counter example and in support of this hypothesis, we now consider V-shaped bent-core molecules with rigid rod-like segments connected at an assigned angle. The two segments of the molecule interact with the segments of all the nearest neighbours on a square lattice, prescribed by a biquadratic interaction. We compute equilibrium averages of different observables with Monte Carlo techniques as a function of temperature and sample size. For the chosen molecular bend angle and symmetric inter-segment interaction between neighbouirng molecules, the 2D system shows two transitions as a function of T: the higher one at T1 leads to a topological ordering of defects associated with the major molecular axis without a crossover, imparting uniaxial symmetry to the medium described by the first fundamental group of the order parameter space $\pi_{1}$= $Z_{2}$ (inversion symmetry). The second at T2 leads to a medium displaying biaxial symmetry with $\pi_{1}$ = Q (quaternion group). The biaxial phase shows a self-similar microscopic structure with the three axes showing power law correlations with vanishing exponents as the temperature decreases.


title: Comments on the paper "Exact solutions of nonlinear diffusion-convection-reaction equation: A Lie symmetry approach"

abstract: This comment is devoted to the paper "Exact solutions of nonlinear diffusion-convection-reaction equation: A Lie symmetry approach" (CNSNS, vol. 67 (2019), 253-263) in which several results are not new because were derived much earlier. Moreover, some results in the paper are incorrect or incomplete.


title: Dynamic Urban Planning: an Agent-Based Model Coupling Mobility Mode and Housing Choice. Use case Kendall Square

abstract: As cities become increasingly populated, urban planning plays a key role in ensuring the equitable and inclusive development of metropolitan areas. MIT City Science group created a data-driven tangible platform, CityScope, to help different stakeholders, such as government representatives, urban planners, developers, and citizens, collaboratively shape the urban scenario through the real-time impact analysis of different urban interventions. This paper presents an agent-based model that characterizes citizens' behavioural patterns with respect to housing and mobility choice that will constitute the first step in the development of a dynamic incentive system for an open interactive governance process. The realistic identification and representation of the criteria that affect this decision-making process will help understand and evaluate the impacts of potential housing incentives that aim to promote urban characteristics such as equality, diversity, walkability, and efficiency. The calibration and validation of the model have been performed in a well-known geographic area for the Group: Kendall Square in Cambridge, MA.


title: Duality for convex infinite optimization on linear spaces

abstract: This note establishes a limiting formula for the conic Lagrangian dual of a convex infinite optimization problem, correcting the classical version of Karney [Math. Programming 27 (1983) 75-82] for convex semi-infinite programs. A reformulation of the convex infinite optimization problem with a single constraint leads to a limiting formula for the corresponding Lagrangian dual, called sup-dual, and also for the primal problem in the case when strong Slater condition holds, which also entails strong sup-duality.


title: Quantifying Social Biases in NLP: A Generalization and Empirical Comparison of Extrinsic Fairness Metrics

abstract: Measuring bias is key for better understanding and addressing unfairness in NLP/ML models. This is often done via fairness metrics which quantify the differences in a model's behaviour across a range of demographic groups. In this work, we shed more light on the differences and similarities between the fairness metrics used in NLP. First, we unify a broad range of existing metrics under three generalized fairness metrics, revealing the connections between them. Next, we carry out an extensive empirical comparison of existing metrics and demonstrate that the observed differences in bias measurement can be systematically explained via differences in parameter choices for our generalized metrics.


title: Real-space entanglement of quantum fields

abstract: We introduce a new method permitting the analytical determination of entanglement entropy (and related quantities) between configurations of a quantum field, which is either free or in interaction with a classical source, at two distinct spatial locations. We show how such a setup can be described by a bipartite, continuous Gaussian system. This allows us to derive explicit and exact formulas for the entanglement entropy, the mutual information and the quantum discord, solely in terms of the Fourier-space power spectra of the field. This contrasts with previous studies, which mostly rely on numerical considerations. As an illustration, we apply our formalism to massless fields in flat space, where exact expressions are derived that only involve the ratio between the size of the regions over which the field is coarse-grained, and the distance between these regions. In particular, we recover the well-known fact that mutual information decays as the fourth power of this ratio at large distances, as previously observed in numerical works. Our method leads to the first analytical derivation of this result, and to an exact formula that also applies to arbitrary distances. Finally, we determine the quantum discord and find that it identically vanishes (unless coarse-graining is performed over smeared spheres, in which case it obeys the same suppression at large distance as mutual information).


title: Inhomogeneous global minimizers to the one-phase free boundary problem

abstract: Given a global 1-homogeneous minimizer $U_0$ to the Alt-Caffarelli energy functional, with $sing(F(U_0)) = \{0\}$, we provide a foliation of the half-space $\R^{n} \times [0,+\infty)$ with dilations of graphs of global minimizers $\underline U \leq U_0 \leq \bar U$ with analytic free boundaries at distance 1 from the origin.


title: Privacy-Preserving Image Acquisition Using Trainable Optical Kernel

abstract: Preserving privacy is a growing concern in our society where sensors and cameras are ubiquitous. In this work, for the first time, we propose a trainable image acquisition method that removes the sensitive identity revealing information in the optical domain before it reaches the image sensor. The method benefits from a trainable optical convolution kernel which transmits the desired information while filters out the sensitive content. As the sensitive content is suppressed before it reaches the image sensor, it does not enter the digital domain therefore is unretrievable by any sort of privacy attack. This is in contrast with the current digital privacy-preserving methods that are all vulnerable to direct access attack. Also, in contrast with the previous optical privacy-preserving methods that cannot be trained, our method is data-driven and optimized for the specific application at hand. Moreover, there is no additional computation, memory, or power burden on the acquisition system since this processing happens passively in the optical domain and can even be used together and on top of the fully digital privacy-preserving systems. The proposed approach is adaptable to different digital neural networks and content. We demonstrate it for several scenarios such as smile detection as the desired attribute while the gender is filtered out as the sensitive content. We trained the optical kernel in conjunction with two adversarial neural networks where the analysis network tries to detect the desired attribute and the adversarial network tries to detect the sensitive content. We show that this method can reduce 65.1% of sensitive content when it is selected to be the gender and it only loses 7.3% of the desired content. Moreover, we reconstruct the original faces using the deep reconstruction method that confirms the ineffectiveness of reconstruction attacks to obtain the sensitive content.


title: Complexity as a holographic probe of strong cosmic censorship

abstract: Based on reasonable assumptions, we propose a new expression for Lloyd's bound, which confines the complexity growth of charged black holes. We then revisit holographic complexity for charged black branes in the presence of a finite cutoff. Using the proposed Lloyd's bound we find a relation between the UV and the behind the horizon cutoff. This is found to be consistent with the factorization of the partition function at leading order in large N. We argue that the result may be thought of as a holographic realization of strong cosmic censorship.


title: The cross-sectional shape and height expansion of coronal loops: High-resolution Coronal Imager (Hi-C) analysis of AR 12712

abstract: Coronal loop observations have existed for many decades yet the precise shape of these fundamental coronal structures is still widely debated since the discovery that they appear to undergo negligible expansion between their footpoints and apex. In this work a selection of eight EUV loops and their twenty-two sub-element strands are studied from the second successful flight of NASA's High resolution Coronal Imager (Hi-C 2.1). Four of the loops correspond to open fan structures with the other four considered to be magnetically closed loops. Width analysis is performed on the loops and their sub-resolution strands using our method of fitting multiple Gaussian profiles to cross-sectional intensity slices. It is found that whilst the magnetically closed loops and their sub-element strands do not expand along their observable length, open fan structures may expand an additional 150% of their initial width. Following recent work, the Pearson correlation coefficient between peak intensity and loop/strand width are found to be predominantly positively correlated for the loops (~88%) and their sub-element strands (~80%). These results align with the hypothesis of Klimchuk & DeForest that loops and - for the first time - their sub-element strands have approximately circular cross-sectional profiles.


title: An effective theory for higher-dimensional black holes and applications to metastable antibranes

abstract: Despite their consequential applications, metastable states of antibranes in warped throats are not yet fully understood. In this thesis, we provide new information on various aspects of these metastable antibranes through applications of the blackfold effective theory for higher-dimensional black holes. As concrete examples, we study the conjectured metastable state of polarised anti-D3 branes at the tip of the Klebanov-Strassler (KS) throat in type IIB supergravity and the analogous state of polarised anti-M2 branes at the tip of the Cvetic-Gibbons-Lu-Pope (CGLP) throat in eleven-dimensional supergravity. For anti-D3 branes in KS throat, we provide novel evidence for the existence of the metastable state exactly where no-go theorems are lifted. In the extremal limit, we recover directly in supergravity the metastable states originally discovered by Kachru, Pearson, and Verlinde (KPV). Away from extremality, we uncover a metastable wrapped black NS5 state. We observe that such metastability is lost when the wrapped NS5 is heated sufficiently that its horizon geometry resembles that of a black anti-D3. We study the classical stability of the KPV state under generic long-wavelength deformations. We observe that, with regards to considered perturbations and regime of parameters, the state is classically stable. A study of anti-M2 branes in CGLP throat reveals many similarities to that of the anti-D3 branes. We recover directly in supergravity the Klebanov-Pufu (KP) state at extremality, and our finite temperature results fit suggestively well with known, complementary no-go theorems. However, we discover an unexpected, exotic pattern of thermal transitions of the KP state different from that of the KPV. This thesis contains also a pedagogical introduction to the blackfold formalism, focusing on aspects immediately relevant to applications to metastable antibranes.


title: Properties of the Environment of Galaxies in Clusters of Galaxies CL 0024+1654 and RX J0152.7-1357

abstract: We report the results of combined analyses of X-ray and optical data of two galaxy clusters, CL 0024$+$1654 and RX J0152.7$-$1357 at redshift $z = 0.395$ and $z = 0.830$, respectively, which offer a holistic physical description of the two clusters. Our X-ray analysis yields temperature and density profile of the gas in the intra-cluster medium (ICM). Using optical photometric and spectroscopic data, complemented with mass distribution from gravitational lensing study, we investigate any possible correlation between the physical properties of the galaxy members, i.e., their color, morphology, and star formation rate (SFR) with their environments. We quantify the properties of the environment of each galaxy by galaxy number density, ICM temperature, and mass density. Although our result shows that the two clusters exhibit a weaker correlation compared to relaxed clusters, it still confirms the significant effect of the ICM on the SFRs in the galaxies. The closer relation between galaxy physical property and the condition of its immediate environment found in this work indicates the locality of galaxy evolution, even within a larger bound system such as cluster. Various physical mechanisms are suggested to explain the relation between the properties of galaxies and their environment.


title: Deciphering the light vector meson contribution to the cross sections of $e^+e^-$ annihilations into the open-strange channels through a combined analysis

abstract: In this work, we perform a combined analysis to the measured data of the cross section of open-strange processes $e^+e^- \to K^+K^-$, $e^+e^- \to K\bar{K}^{*}+c.c.$, $e^+e^- \to K^{*+}K^{*-}$, $e^+e^- \to K_1(1270)^+K^-$, $e^+e^- \to K_1(1400)^+K^-$, $e^+e^- \to K_2^{*}(1430)\bar{K}+c.c.$ and $e^+e^- \to K(1460)^+K^-$ with the support of study of hadron spectroscopy. We reveal the contribution of the possible light vector mesons around 2 GeV to reproduce the cross section data of the reported open-strange processes from $e^+e^-$ annihilation which may provide a new perspective to construct the light vector meson family and understand the $Y(2175)$.


title: Towards Universal Neural Network Potential for Material Discovery Applicable to Arbitrary Combination of 45 Elements

abstract: Computational material discovery is under intense study owing to its ability to explore the vast space of chemical systems. Neural network potentials (NNPs) have been shown to be particularly effective in conducting atomistic simulations for such purposes. However, existing NNPs are generally designed for narrow target materials, making them unsuitable for broader applications in material discovery. To overcome this issue, we have developed a universal NNP called PreFerred Potential (PFP), which is able to handle any combination of 45 elements. Particular emphasis is placed on the datasets, which include a diverse set of virtual structures used to attain the universality. We demonstrated the applicability of PFP in selected domains: lithium diffusion in LiFeSO${}_4$F, molecular adsorption in metal-organic frameworks, an order-disorder transition of Cu-Au alloys, and material discovery for a Fischer-Tropsch catalyst. They showcase the power of PFP, and this technology provides a highly useful tool for material discovery.


title: Positivity and representations of surface groups

abstract: In arXiv:1802.02833 Guichard and Wienhard introduced the notion of $\Theta$-positivity, a generalization of Lusztig's total positivity to real Lie groups that are not necessarily split. Based on this notion, we introduce in this paper $\Theta$-positive representations of surface groups. We prove that $\Theta$-positive representations are $\Theta$-Anosov. This implies that $\Theta$-positive representations are discrete and faithful and that the set of $\Theta$-positive representations is open in the representation variety. We show that the set of $\Theta$-positive representations is closed within the set of representations that do not virtually factor through a parabolic subgroup. From this we deduce that for any simple Lie group $\mathsf G$ admitting a $\Theta$-positive structure there exist components consisting of $\Theta$-positive representations. More precisely we prove that the components parametrized using Higgs bundles methods in arXiv:2101.09377 consist of $\Theta$-positive representations.


title: Factoring Variants of Chebyshev Polynomials with Minimal Polynomials of $\cos(\frac{2\pi}{d})$

abstract: We solve the problem of factoring polynomials $V_n(x) \pm 1$ and $W_n(x) \pm 1$ where $V_n(x)$ and $W_n(x)$ are Chebyshev polynomials of the third and fourth kinds. The method of proof is based on previous work by Wolfram [12] for factoring variants of Chebyshev polynomials of the first and second kinds, $T_n(x) \pm 1$ and $U_n(x) \pm 1$. We also show that, in general, there are no factorizations of variants of Chebyshev polynomials of the fifth and sixth kinds, $X_n(x) \pm 1$ and $Y_n(x) \pm 1$ using minimal polynomials of $\cos(\frac{2\pi}{d})$.


title: A Dictionary-Passing Translation of Featherweight Go

abstract: The Go programming language is an increasingly popular language but some of its features lack a formal investigation. This article explains Go's resolution mechanism for overloaded methods and its support for structural subtyping by means of translation from Featherweight Go to a simple target language. The translation employs a form of dictionary passing known from type classes in Haskell and preserves the dynamic behavior of Featherweight Go programs.


title: Topos and Stacks of Deep Neural Networks

abstract: Every known artificial deep neural network (DNN) corresponds to an object in a canonical Grothendieck's topos; its learning dynamic corresponds to a flow of morphisms in this topos. Invariance structures in the layers (like CNNs or LSTMs) correspond to Giraud's stacks. This invariance is supposed to be responsible of the generalization property, that is extrapolation from learning data under constraints. The fibers represent pre-semantic categories (Culioli, Thom), over which artificial languages are defined, with internal logics, intuitionist, classical or linear (Girard). Semantic functioning of a network is its ability to express theories in such a language for answering questions in output about input data. Quantities and spaces of semantic information are defined by analogy with the homological interpretation of Shannon's entropy of P.Baudot and D.Bennequin in 2015). They generalize the measures found by Carnap and Bar-Hillel (1952). Amazingly, the above semantical structures are classified by geometric fibrant objects in a closed model category of Quillen, then they give rise to homotopical invariants of DNNs and of their semantic functioning. Intentional type theories (Martin-Loef) organize these objects and fibrations between them. Information contents and exchanges are analyzed by Grothendieck's derivators.


title: The Convergence Rate of SGD's Final Iterate: Analysis on Dimension Dependence

abstract: Stochastic Gradient Descent (SGD) is among the simplest and most popular methods in optimization. The convergence rate for SGD has been extensively studied and tight analyses have been established for the running average scheme, but the sub-optimality of the final iterate is still not well-understood. shamir2013stochastic gave the best known upper bound for the final iterate of SGD minimizing non-smooth convex functions, which is $O(\log T/\sqrt{T})$ for Lipschitz convex functions and $O(\log T/ T)$ with additional assumption on strongly convexity. The best known lower bounds, however, are worse than the upper bounds by a factor of $\log T$. harvey2019tight gave matching lower bounds but their construction requires dimension $d= T$. It was then asked by koren2020open how to characterize the final-iterate convergence of SGD in the constant dimension setting. In this paper, we answer this question in the more general setting for any $d\leq T$, proving $\Omega(\log d/\sqrt{T})$ and $\Omega(\log d/T)$ lower bounds for the sub-optimality of the final iterate of SGD in minimizing non-smooth Lipschitz convex and strongly convex functions respectively with standard step size schedules. Our results provide the first general dimension dependent lower bound on the convergence of SGD's final iterate, partially resolving a COLT open question raised by koren2020open. We also present further evidence to show the correct rate in one dimension should be $\Theta(1/\sqrt{T})$, such as a proof of a tight $O(1/\sqrt{T})$ upper bound for one-dimensional special cases in settings more general than koren2020open.


title: Physics of Thermonuclear Explosions: Magnetic Field Effects on Deflagration Fronts and Observable Consequences

abstract: We present a study of the influence of magnetic field strength and morphology in Type Ia Supernovae and their late-time light curves and spectra. In order to both capture self-consistent magnetic field topologies as well evolve our models to late times, a two stage approach is taken. We study the early deflagration phase (1s) using a variety of magnetic field strengths, and find that the topology of the field is set by the burning, independent of the initial strength. We study late time (~1000 days) light curves and spectra with a variety of magnetic field topologies, and infer magnetic field strengths from observed supernovae. Lower limits are found to be 106G. This is determined by the escape, or lack thereof, of positrons that are tied to the magnetic field. The first stage employs 3d MHD and a local burning approximation, and uses the code Enzo. The second stage employs a hybrid approach, with 3D radiation and positron transport, and spherical hydrodynamics. The second stage uses the code HYDRA. In our models, magnetic field amplification remains small during the early deflagration phase. Late-time spectra bear the imprint of both magnetic field strength and morphology. Implications for alternative explosion scenarios are discussed.


title: $\bar{\nu}_{\mu}$ induced quasielastic production of hyperons leading to pions

abstract: The quasielastic production cross sections and polarizations of the hyperons induced by ${\bar\nu}_\mu$ on the free nucleon as well as from $^{40}$Ar in the sub-GeV energy region has been reviewed [1-5]. The effects of the second class currents in the axial vector sector with and without T-invariance as well as the effect of SU(3) symmetry breaking are also studied. We find that the cross sections and the various polarization components can effectively be used to determine the axial vector transition form factors in the strangeness sector and to test the validity of various symmetries of the weak hadronic currents like G-invariance, T-invariance and SU(3) symmetry. These hyperons decay dominantly into pions giving an additional contribution to the weak pion production induced by the antineutrinos. In the case of nuclear targets like $^{40}$Ar, this contribution is shown to be significant when compared with the pion production by the $\Delta$ excitations in the energy range of $E_{\bar{\nu}_{\mu}} \le 0.7$ GeV [1]. This study could be useful for the DUNE experiment where argon will be used as the target material and the electronic imaging of particles is possible and the particle tracks can be identified.


title: ACN: Adversarial Co-training Network for Brain Tumor Segmentation with Missing Modalities

abstract: Accurate segmentation of brain tumors from magnetic resonance imaging (MRI) is clinically relevant in diagnoses, prognoses and surgery treatment, which requires multiple modalities to provide complementary morphological and physiopathologic information. However, missing modality commonly occurs due to image corruption, artifacts, different acquisition protocols or allergies to certain contrast agents in clinical practice. Though existing efforts demonstrate the possibility of a unified model for all missing situations, most of them perform poorly when more than one modality is missing. In this paper, we propose a novel Adversarial Co-training Network (ACN) to solve this issue, in which a series of independent yet related models are trained dedicated to each missing situation with significantly better results. Specifically, ACN adopts a novel co-training network, which enables a coupled learning process for both full modality and missing modality to supplement each other's domain and feature representations, and more importantly, to recover the `missing' information of absent modalities. Then, two unsupervised modules, i.e., entropy and knowledge adversarial learning modules are proposed to minimize the domain gap while enhancing prediction reliability and encouraging the alignment of latent representations, respectively. We also adapt modality-mutual information knowledge transfer learning to ACN to retain the rich mutual information among modalities. Extensive experiments on BraTS2018 dataset show that our proposed method significantly outperforms all state-of-the-art methods under any missing situation.


title: Quantum harmonic oscillators and Feynman-Kac path integrals for linear diffusive particles

abstract: We propose a new solvable class of multidimensional quantum harmonic oscillators for a linear diffusive particle and a quadratic energy absorbing well associated with a semi-definite positive matrix force. Under natural and easily checked controllability conditions, the ground state and the zero-point energy are explicitly computed in terms of a positive fixed point of a continuous time algebraic Riccati matrix equation. We also present an explicit solution of normalized and time dependent Feynman-Kac measures in terms of a time varying linear dynamical system coupled with a differential Riccati matrix equation. A refined non asymptotic analysis of the stability of these models is developed based on a recently developed Floquet-type representation of time varying exponential semigroups of Riccati matrices. We provide explicit and non asymptotic estimates of the exponential decays to equilibrium of Feynman-Kac semigroups in terms of Wasserstein distances or Boltzmann-relative entropy. For reversible models we develop a series of functional inequalities including de Bruijn identity, Fisher's information decays, log-Sobolev inequalities, and entropy contraction estimates. In this context, we also provide a complete and explicit description of all the spectrum and the excited states of the Hamiltonian, yielding what seems to be the first result of this type for this class of models. We illustrate these formulae with the traditional harmonic oscillator associated with real time Brownian particles and Mehler's formula. The analysis developed in this article can also be extended to solve time dependent Schrodinger equations equipped with time varying linear diffusions and quadratic potential functions.


title: Towards van der Waerden's conjecture

abstract: How often is a quintic polynomial solvable by radicals? We establish that the number of such polynomials, monic and irreducible with integer coefficients in $[-H,H]$, is $O(H^{3.91})$. More generally, we show that if $n \ge 3$ and $n \notin \{ 7, 8, 10 \}$ then there are $O(H^{n-1.017})$ monic, irreducible polynomials of degree $n$ with integer coefficients in $[-H,H]$ and Galois group not containing $A_n$. Save for the alternating group and degrees $7,8,10$, this establishes a 1936 conjecture of van der Waerden.


title: Adaptive Random Quantum Eigensolver

abstract: We propose an adaptive random quantum algorithm to obtain an optimized eigensolver. Specifically, we introduce a general method to parametrize and optimize the probability density function of a random number generator, which is the core of stochastic algorithms. We follow a bioinspired evolutionary mutation method to introduce changes in the involved matrices. Our optimization is based on two figures of merit: learning speed and learning accuracy. This method provides high fidelities for the searched eigenvectors and faster convergence on the way to quantum advantage with current noisy intermediate-scaled quantum computers.


title: Artificial event horizons in Weyl semimetal heterostructures and their non-equilibrium signatures

abstract: We investigate transport in type-I/type-II Weyl semi\-metal heterostructures that realize effective black- or white-hole event horizons. We provide an exact solution to the scattering problem at normal incidence and low energies, both for a sharp and a slowly-varying Weyl cone tilt profile. In the latter case, we find two channels with transmission amplitudes analog to those of Hawking radiation. Whereas the Hawking-like signatures of these two channels cancel in equilibrium, we demonstrate that one can favor the contribution of either channel using a non-equilibrium state, either by irradiating the type-II region or by coupling it to a magnetic lead. This in turn gives rise to a peak in the two-terminal differential conductance which can serve as an experimental indicator of the artificial event horizon.


title: Integrate-and-Fire Neurons for Low-Powered Pattern Recognition

abstract: Embedded systems acquire information about the real world from sensors and process it to make decisions and/or for transmission. In some situations, the relationship between the data and the decision is complex and/or the amount of data to transmit is large (e.g. in biologgers). Artificial Neural Networks (ANNs) can efficiently detect patterns in the input data which makes them suitable for decision making or compression of information for data transmission. However, ANNs require a substantial amount of energy which reduces the lifetime of battery-powered devices. Therefore, the use of Spiking Neural Networks can improve such systems by providing a way to efficiently process sensory data without being too energy-consuming. In this work, we introduce a low-powered neuron model called Integrate-and-Fire which exploits the charge and discharge properties of the capacitor. Using parallel and series RC circuits, we developed a trainable neuron model that can be expressed in a recurrent form. Finally, we trained its simulation with an artificially generated dataset of dog postures and implemented it as hardware that showed promising energetic properties. This paper is the full text of the research, presented at the 20th International Conference on Artificial Intelligence and Soft Computing Web System (ICAISC 2021)


title: Dataset and Benchmarking of Real-Time Embedded Object Detection for RoboCup SSL

abstract: When producing a model to object detection in a specific context, the first obstacle is to have a dataset labeling the desired classes. In RoboCup, some leagues already have more than one dataset to train and evaluate a model. However, in the Small Size League (SSL), there is not such dataset available yet. This paper presents an open-source dataset to be used as a benchmark for real-time object detection in SSL. This work also presented a pipeline to train, deploy, and evaluate Convolutional Neural Networks (CNNs) models in a low-power embedded system. This pipeline was used to evaluate the proposed dataset with state-of-art optimized models. In this dataset, the MobileNet SSD v1 achieves 44.88% AP (68.81% AP50) at 94 Frames Per Second (FPS) while running on an SSL robot.


title: Software quality: A Historical and Synthetic Content Analysis

abstract: Interconnected computers and software systems have become an indispensable part of people's lives, therefore software quality research is becoming more and more important. There have been multiple attempts to synthesize knowledge gained in software quality research, however, they were focused mainly on single aspects of software quality and not to structure the knowledge in a holistic way. The aim of our study was to close this gap. The software quality publications were harvested from the Scopus bibliographic database. The metadata was exported first to CRexlporer, which was employed to identify historical roots, and next to VOSViewer, which was used as a part of the synthetic content analysis. In our study we defined synthetic context analysis as a triangulation of bibliometrics and content analysis. Our search resulted in 14451 publications. The performance bibliometric study showed that the production of research publications relating to software quality is currently following an exponential growth trend and that the software quality research community is growing. The most productive country was the United States and the most productive Institution The Florida Atlantic University. The synthetic content analysis revealed that the published knowledge can be structured into 10 themes, the most important being the themes regarding software quality improvement with enhancing software engineering, advanced software testing, and improved defect and fault prediction with machine learning and data mining. According to the analysis of the hot topics, it seems that future research will be directed into developing and using a full specter of new artificial intelligence tools (not just machine learning and data mining) and focusing on how to assure software quality in agile development paradigms.


title: BNPqte: A Bayesian Nonparametric Approach to Causal Inference on Quantiles in R

abstract: In this article, we introduce the BNPqte R package which implements the Bayesian nonparametric approach of Xu, Daniels and Winterstein (2018) for estimating quantile treatment effects in observational studies. This approach provides flexible modeling of the distributions of potential outcomes, so it is capable of capturing a variety of underlying relationships among the outcomes, treatments and confounders and estimating multiple quantile treatment effects simultaneously. Specifically, this approach uses a Bayesian additive regression trees (BART) model to estimate the propensity score and a Dirichlet process mixture (DPM) of multivariate normals model to estimate the conditional distribution of the potential outcome given the estimated propensity score. The BNPqte R package provides a fast implementation for this approach by designing efficient R functions for the DPM of multivariate normals model in joint and conditional density estimation. These R functions largely improve the efficiency of the DPM model in density estimation, compared to the popular DPpackage. BART-related R functions in the BNPqte R package are inherited from the BART R package with two modifications on variable importance and split probability. To maximize computational efficiency, the actual sampling and computation for each model are carried out in C++ code. The Armadillo C++ library is also used for fast linear algebra calculations.


title: Conjugacy classes of autohomeomorphisms of $\mathbb{N}^*$

abstract: We present some problems related to the conjugacy classes of $\mathsf{Aut}(\mathbb{N}^*)$.


title: The Reward-Penalty-Selection Problem

abstract: The Set Cover Problem (SCP) and the Hitting Set Problem (HSP) are well-studied optimization problems. In this paper we introduce the Reward-Penalty-Selection Problem (RPSP) which can be understood as a combination of the SCP and the HSP where the objectives of both problems are contrary to each other. Applications of the RPSP can be found in the context of combinatorial exchanges in order to solve the corresponding winner determination problem. We give complexity results for the minimization and the maximization problem as well as for several variants with additional restrictions. Further, we provide an algorithm that runs in polynomial time for the special case of laminar sets and a dynamic programming approach for the case where the instance can be represented by a tree or a graph with bounded tree-width. We further present a graph theoretical generalization of this problem and results regarding its complexity.


title: Shadow cast by Kerr-like black hole in the presence of plasma in Einstein-bumblebee gravity

abstract: In the Einstein-bumblebee gravity, the Lorentz symmetry is spontaneously broken by a vector field. In this paper, we attempt to test the Lorentz symmetry via the observation of the shadow cast by the Kerr-like black hole with or without plasma. A novel phenomenon of the Lorentz-violating parameter on the shadow is observed. The result shows that when the observer gradually moves from the poles to the equatorial plane, the shadow radius $R_{\rm s}$ firstly decreases and then increases with the Lorentz-violating parameter. Such nonmonotonic behavior provides us an important understanding on the black hole shadow in the Einstein-bumblebee gravity. Besides, three more distortion observables are calculated, and found to increase with the Lorentz-violating parameter. Moreover, when a homogeneous plasma is present, the motion of the photon is analyzed. We further observe that the refractive index shrinks the size, while enhances the deformation of the shadow. Finally, adopting the observed data of the diameter of M87$^*$, we find the refractive index is more favored in (0.914, 1).


title: Timing and spectral variability of high mass X-ray pulsar GX 301--2 over orbital phases observed by Insight-HXMT

abstract: We report the orbital X-ray variability of high mass X-ray binary (HMXB) GX301--2. GX301--2 undergone a spin up process in 2018--2020 with the period evolving from $\sim$ 685 s to 670 s. The energy resolved pulse-profiles of the pulsar in 1--60 keV varied from single peaked and sinusoidal shapes to multi-peaked across different orbital phases. Pulse fractions evolving over orbit had negative correlations with the X-ray flux. The broad-band X-ray energy spectrum of the pulsar can be described with a partial covering negative positive cutoff power-law continuum model. Near the periastron passage of the pulsar we found a strong variation in the additional column density ($NH_{2}$), which correlated with variation of the flux. Curves of growth for both Fe K$\alpha$ and Fe K$\beta$ lines were plotted to investigate the distribution of matter around neutron star. We have also found the evidence of two cyclotron absorption lines in the phase-averaged spectra in GX301--2, with one line of 30--42 keV and the other line varying in 48--56 keV. Both two line's centroid energies show the similar relationship with X-ray luminosity: positive correlation in lower luminosity range, and negative relation above a critical luminosity of $10^{37}$ erg s$^{-1}$. We estimated the surface magnetic field of the neutron star in GX301--2 at ~$(0.5-2)\times 10^{13}$ G. Two cyclotron line energies have a nearly fixed ratio of ~1.63 while having a low strength ratio (~0.05), suggesting that these two features may actually be one line.


title: A note on the divisibility of the Whitehead square

abstract: We show that if we suppose n>3 and the (2n-1)-stem in the stable homotopy groups of spheres has no 2-torsion, then the Whitehead squares of the identity maps of (2n+1) and (4n+3)-spheres are divisible by 2. Applying the result of G. Wang and Z. Xu on the 61-stem in the stable homotopy groups of spheres, we find that the Kervaire invariant one elements in dimensions 62 and 126 exist.


title: Structure of the space of $GL_4(\mathbb Z_2)$-coinvariants $\mathbb Z_2\otimes_{GL_4(\mathbb Z_2)} PH_*(\mathbb Z_2^4, \mathbb Z_2)$ in some generic degrees and its application

abstract: Let $A$ denote the Steenrod algebra at the prime 2 and let $k = \mathbb Z_2.$ An open problem of homotopy theory is to determine a minimal set of $A$-generators for the polynomial ring $P_q = k[x_1, \ldots, x_q] = H^{*}(k^{q}, k)$ on $q$ generators $x_1, \ldots, x_q$ with $|x_i|= 1.$ Equivalently, one can write down explicitly a basis for the graded vector space $Q^{\otimes q} := k\otimes_{A} P_q$ in each non-negative degree $n.$ This is the content of the classical "hit problem" in literature [30]. Based on this problem, we are interested in the $q$-th cohomological transfer $Tr_q^{A}$ of Singer [39], which is one of the useful tools for describing mod-2 cohomology of the algebra $A.$ This transfer is a linear map from the space of $GL_q(k)$-coinvariant $k\otimes _{GL_q(k)} P((P_q)_n^{*})$ of $Q^{\otimes q}$ to the $k$-cohomology group of the Steenrod algebra, ${\rm Ext}_{A}^{q, q+n}(k, k).$ Here $GL_q(k)$ is the general linear group of degree $q$ over the field $k,$ and $P((P_q)_n^{*})$ is the primitive part of $(P_q)^{*}_n$ under the action of $A.$ Singer conjectured that $Tr_q^{A}$ is a monomorphism, but this remains unanswered for all $q\geq 4.$ The present paper is to devoted to the investigation of this conjecture for the rank 4 case. More specifically, basing the techniques of the hit problem of four variables, we explicitly determine the structure of $k\otimes _{GL_4(k)} P((P_4)_{n}^{*})$ in some generic degrees $n.$ Applying these results and a representation of $Tr_4^{A}$ over the lambda algebra, we notice that Singer's conjecture is true for the rank 4 transfer in those degrees $n$. Also, we give some conjectures on the dimensions of $k\otimes_{GL_q(k)} ((P_4)_n^{*})$ for the remaining degrees $n.$ As a consequence, Singer's conjecture holds for $Tr_4^{A}.$ This study and our previous results have been provided a panorama of the behavior of the fourth cohomological transfer.


title: A note on the modular representation on the $\mathbb Z/2$-homology groups of the fourth power of real projective space and its application

abstract: One knows that, the connected graded ring $P^{\otimes h}= \mathbb Z/2[t_1, \ldots, t_h]= \{P_n^{\otimes h}\}_{n\geq 0},$ which is graded by the degree of the homogeneous terms $P^{\otimes h}_n$ of degree $n$ in $h$ generators with the degree of each $t_i$ being one, admits a left action of $\mathcal A$ as well as a right action of the general linear group $GL_h.$ A central problem of homotopy theory is to determine the structure of the space of $GL_h$-coinvariants, $\mathbb Z/2\otimes_{GL_h}{\rm Ann}_{\overline{\mathcal A}}[P^{\otimes h}_n]^{*}.$ Solving this problem is very difficult and still open for $h\geq 4.$ In this Note, our intent is of studying the dimension of $\mathbb Z/2\otimes_{GL_h}{\rm Ann}_{\overline{\mathcal A}}[P^{\otimes h}_n]^{*}$ for the case $h = 4$ and the "generic" degrees $n$ of the form $n_{k, r, s} = k(2^{s} - 1) + r.2^{s},$ where $k,\, r,\, s$ are positive integers. Applying the results, we investigate the behaviour of the Singer cohomological "transfer" of rank $4.$ Singer's transfer is a homomorphism from a certain subquotient of the divided power algebra $\Gamma(a_1^{(1)}, \ldots, a_h^{(1)})$ to mod-2 cohomology groups ${\rm Ext}_{\mathcal A}^{h, h+*}(\mathbb Z/2, \mathbb Z/2)$ of the algebra $\mathcal A.$ This homomorphism is useful for depicting the Ext groups. Additionally, in higher ranks, by using the results on $\mathcal A$-generators for $P^{\otimes 5}$ and $P^{\otimes 6},$ we show in Appendix that the transfer of rank 5 is an isomorphism in som certain degrees of the form $n_{k, r, s}$, and that the transfer of rank 6 does not detect the non-zero elements $h_2^{2}g_1 = h_4Ph_2\in {\rm Ext}_{\mathcal A}^{6, 6+n_{6, 10, 1}}(\mathbb Z/2, \mathbb Z/2)$, and $D_2\in {\rm Ext}_{\mathcal A}^{6, 6+n_{6, 10, 2}}(\mathbb Z/2, \mathbb Z/2).$ Besides, we also probe the behavior of the Singer transfer of ranks 7 and 8 in internal degrees $\leq 15.$


title: Faulhaber's Formula, Odd Bernoulli Numbers, and the Method of Partial Sums

abstract: Let ``Faulhaber's formula'' refer to an expression for the sum of powers of integers written with terms in n(n+1)/2. Initially, the author used Faulhaber's formula to explain why odd Bernoulli numbers are equal to zero. Next, Cereceda gave alternate proofs of that result and then proved the converse, if odd Bernoulli numbers are equal to zero then we can derive Faulhaber's formula. Here, the original author will give a new proof of the converse using the method of partial sums and mathematical induction.


title: Ensembling Shift Detectors: an Extensive Empirical Evaluation

abstract: The term dataset shift refers to the situation where the data used to train a machine learning model is different from where the model operates. While several types of shifts naturally occur, existing shift detectors are usually designed to address only a specific type of shift. We propose a simple yet powerful technique to ensemble complementary shift detectors, while tuning the significance level of each detector's statistical test to the dataset. This enables a more robust shift detection, capable of addressing all different types of shift, which is essential in real-life settings where the precise shift type is often unknown. This approach is validated by a large-scale statistically sound benchmark study over various synthetic shifts applied to real-world structured datasets.


title: Neural Models for Offensive Language Detection

abstract: Offensive language detection is an ever-growing natural language processing (NLP) application. This growth is mainly because of the widespread usage of social networks, which becomes a mainstream channel for people to communicate, work, and enjoy entertainment content. Many incidents of sharing aggressive and offensive content negatively impacted society to a great extend. We believe contributing to improving and comparing different machine learning models to fight such harmful contents is an important and challenging goal for this thesis. We targeted the problem of offensive language detection for building efficient automated models for offensive language detection. With the recent advancements of NLP models, specifically, the Transformer model, which tackled many shortcomings of the standard seq-to-seq techniques. The BERT model has shown state-of-the-art results on many NLP tasks. Although the literature still exploring the reasons for the BERT achievements in the NLP field. Other efficient variants have been developed to improve upon the standard BERT, such as RoBERTa and ALBERT. Moreover, due to the multilingual nature of text on social media that could affect the model decision on a given tween, it is becoming essential to examine multilingual models such as XLM-RoBERTa trained on 100 languages and how did it compare to unilingual models. The RoBERTa based model proved to be the most capable model and achieved the highest F1 score for the tasks. Another critical aspect of a well-rounded offensive language detection system is the speed at which a model can be trained and make inferences. In that respect, we have considered the model run-time and fine-tuned the very efficient implementation of FastText called BlazingText that achieved good results, which is much faster than BERT-based models.


title: A keyword-driven approach to science

abstract: To a good extent, words can be understood as corresponding to patterns or categories that appeared in order to represent concepts and structures that are particularly important or useful in a given time and space. Words are characterized by not being completely general nor specific, in the sense that the same word can be instantiated or related to several different contexts, depending on specific situations. Indeed, the way in which words are instantiated and associated represents a particularly interesting aspect that can substantially help to better understand the context in which they are employed. Scientific words are no exception to that. In the present work, we approach the associations between a set of particularly relevant words in the sense of being not only frequently used in several areas, but also representing concepts that are currently related to some of the main standing challenges in science. More specifically, the study reported here takes into account the words "prediction", "model", "optimization", "complex", "entropy", "random", "deterministic", "pattern", and "database". In order to complement the analysis, we also obtain a network representing the relationship between the adopted areas. Many interesting results were found. First and foremost, several of the words were observed to have markedly distinct associations in different areas. Biology was found to be related to computer science, sharing associations with databases. Furthermore, for most of the cases, the words "complex", "model", and "prediction" were observed to have several strong associations.


title: An Adversarial Learning based Multi-Step Spoken Language Understanding System through Human-Computer Interaction

abstract: Most of the existing spoken language understanding systems can perform only semantic frame parsing based on a single-round user query. They cannot take users' feedback to update/add/remove slot values through multiround interactions with users. In this paper, we introduce a novel multi-step spoken language understanding system based on adversarial learning that can leverage the multiround user's feedback to update slot values. We perform two experiments on the benchmark ATIS dataset and demonstrate that the new system can improve parsing performance by at least $2.5\%$ in terms of F1, with only one round of feedback. The improvement becomes even larger when the number of feedback rounds increases. Furthermore, we also compare the new system with state-of-the-art dialogue state tracking systems and demonstrate that the new interactive system can perform better on multiround spoken language understanding tasks in terms of slot- and sentence-level accuracy.


title: A Theory of Language Learning

abstract: A theory of language learning is described, which uses Bayesian induction of feature structures (scripts) and script functions. Each word sense in a language is mentally represented by an m-script, a script function which embodies all the syntax and semantics of the word. M-scripts form a fully-lexicalised unification grammar, which can support adult language. Each word m-script can be learnt robustly from about six learning examples. The theory has been implemented as a computer model, which can bootstrap-learn a language from zero vocabulary. The Bayesian learning mechanism is (1) Capable: to learn arbitrarily complex meanings and syntactic structures; (2) Fast: learning these structures from a few examples each; (3) Robust: learning in the presence of much irrelevant noise, and (4) Self-repairing: able to acquire implicit negative evidence, using it to learn exceptions. Children learning language are clearly all of (1) - (4), whereas connectionist theories fail on (1) and (2), and symbolic theories fail on (3) and (4). The theory is in good agreement with many key facts of language acquisition, including facts which are problematic for other theories. It is compared with over 100 key cross-linguistic findings about acquisition of the lexicon, phrase structure, morphology, complementation and control, auxiliaries, verb argument structures, gaps and movement - in nearly all cases giving unforced agreement without extra assumptions.


title: An evaluation of template and ML-based generation of user-readable text from a knowledge graph

abstract: Typical user-friendly renderings of knowledge graphs are visualisations and natural language text. Within the latter HCI solution approach, data-driven natural language generation systems receive increased attention, but they are often outperformed by template-based systems due to suffering from errors such as content dropping, hallucination, or repetition. It is unknown which of those errors are associated significantly with low quality judgements by humans who the text is aimed for, which hampers addressing errors based on their impact on improving human evaluations. We assessed their possible association with an experiment availing of expert and crowdsourced evaluations of human authored text, template generated text, and sequence-to-sequence model generated text. The results showed that there was no significant association between human authored texts with errors and the low human judgements of naturalness and quality. There was also no significant association between machine learning generated texts with dropped or hallucinated slots and the low human judgements of naturalness and quality. Thus, both approaches appear to be viable options for designing a natural language interface for knowledge graphs.


title: Progressive Open-Domain Response Generation with Multiple Controllable Attributes

abstract: It is desirable to include more controllable attributes to enhance the diversity of generated responses in open-domain dialogue systems. However, existing methods can generate responses with only one controllable attribute or lack a flexible way to generate them with multiple controllable attributes. In this paper, we propose a Progressively trained Hierarchical Encoder-Decoder (PHED) to tackle this task. More specifically, PHED deploys Conditional Variational AutoEncoder (CVAE) on Transformer to include one aspect of attributes at one stage. A vital characteristic of the CVAE is to separate the latent variables at each stage into two types: a global variable capturing the common semantic features and a specific variable absorbing the attribute information at that stage. PHED then couples the CVAE latent variables with the Transformer encoder and is trained by minimizing a newly derived ELBO and controlled losses to produce the next stage's input and produce responses as required. Finally, we conduct extensive evaluations to show that PHED significantly outperforms the state-of-the-art neural generation models and produces more diverse responses as expected.


title: Inverse design of soft materials via a deep-learning-based evolutionary strategy

abstract: Colloidal self-assembly -- the spontaneous organization of colloids into ordered structures -- has been considered key to produce next-generation materials. However, the present-day staggering variety of colloidal building blocks and the limitless number of thermodynamic conditions make a systematic exploration intractable. The true challenge in this field is to turn this logic around, and to develop a robust, versatile algorithm to inverse design colloids that self-assemble into a target structure. Here, we introduce a generic inverse design method to efficiently reverse-engineer crystals, quasicrystals, and liquid crystals by targeting their diffraction patterns. Our algorithm relies on the synergetic use of an evolutionary strategy for parameter optimization, and a convolutional neural network as an order parameter, and provides a new way forward for the inverse design of experimentally feasible colloidal interactions, specifically optimized to stabilize the desired structure.


title: ICDAR 2021 Competition on Scientific Literature Parsing

abstract: Scientific literature contain important information related to cutting-edge innovations in diverse domains. Advances in natural language processing have been driving the fast development in automated information extraction from scientific literature. However, scientific literature is often available in unstructured PDF format. While PDF is great for preserving basic visual elements, such as characters, lines, shapes, etc., on a canvas for presentation to humans, automatic processing of the PDF format by machines presents many challenges. With over 2.5 trillion PDF documents in existence, these issues are prevalent in many other important application domains as well. Our ICDAR 2021 Scientific Literature Parsing Competition (ICDAR2021-SLP) aims to drive the advances specifically in document understanding. ICDAR2021-SLP leverages the PubLayNet and PubTabNet datasets, which provide hundreds of thousands of training and evaluation examples. In Task A, Document Layout Recognition, submissions with the highest performance combine object detection and specialised solutions for the different categories. In Task B, Table Recognition, top submissions rely on methods to identify table components and post-processing methods to generate the table structure and content. Results from both tasks show an impressive performance and opens the possibility for high performance practical applications.


title: Optimized Wireless Control and Telemetry Network for Mobile Soccer Robots

abstract: In a diverse set of robotics applications, including RoboCup categories, mobile robots require control commands to interact with surrounding environment correctly. These control commands should come wirelessly to not interfere in robots' movement; also, the communication has a set of requirements, including low latency and consistent delivery. This paper presents a complete communication architecture consisting of computer communication with a base station, which transmits the data to robots and returns robots telemetry to the computer. With the proposed communication, it is possible to send messages in less than 4.5ms for six robots with telemetry enables in all of them.


title: Overview of BioASQ 2020: The eighth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering

abstract: In this paper, we present an overview of the eighth edition of the BioASQ challenge, which ran as a lab in the Conference and Labs of the Evaluation Forum (CLEF) 2020. BioASQ is a series of challenges aiming at the promotion of systems and methodologies for large-scale biomedical semantic indexing and question answering. To this end, shared tasks are organized yearly since 2012, where different teams develop systems that compete on the same demanding benchmark datasets that represent the real information needs of experts in the biomedical domain. This year, the challenge has been extended with the introduction of a new task on medical semantic indexing in Spanish. In total, 34 teams with more than 100 systems participated in the three tasks of the challenge. As in previous years, the results of the evaluation reveal that the top-performing systems managed to outperform the strong baselines, which suggests that state-of-the-art systems keep pushing the frontier of research through continuous improvements.


title: Classification of Contract-Amendment Relationships

abstract: In Contract Life-cycle Management (CLM), managing and tracking the master agreements and their associated amendments is essential, in order to be kept informed with different due dates and obligations. An automatic solution can facilitate the daily jobs and improve the efficiency of legal practitioners. In this paper, we propose an approach based on machine learning (ML) and Natural Language Processing (NLP) to detect the amendment relationship between two documents. The algorithm takes two PDF documents preprocessed by OCR (Optical Character Recognition) and NER (Named Entity Recognition) as input, and then it builds the features of each document pair and classifies the relationship. We experimented with different configurations on a dataset consisting of 1124 pairs of contract-amendment documents in English and French. The best result obtained a F1-score of 91%, which outperformed 23% compared to a heuristic-based baseline.


title: Dynamical Casimir Effect and Work in Fermionic Fields

abstract: We consider a quantum massless fermionic field in (1+1) dimensions in the case of moving boundaries. We work in the canonical approach in order to find a Hamiltonian describing the dynamics of the field. Thus, we study the statistics of work and particles produced from the vacuum by a linear driving of a boundary.


title: Rate-Splitting Random Access Mechanism for Massive Machine Type Communications in 5G Cellular Internet-of-Things

abstract: The cellular Internet-of-Things has resulted in the deployment of millions of machine-type communication (MTC) devices. These massive number of devices must communicate with a single gNodeB (gNB) via the random access channel (RACH) mechanism. However, existing RACH mechanisms are inefficient when dealing with such large number of devices. To address this issue, we propose the rate-splitting random access (RSRA) mechanism, which uses rate splitting and decoding in rate-splitting multiple access (RSMA) to improve RACH success rates. The proposed mechanism divides the message into common and private messages and enhances the decoding performance. We demonstrate, using extensive simulations, that the proposed RSRA mechanism significantly improves the success rate of MTC in cellular IoT networks. We also evaluate the performance of the proposed mechanism with increasing number of devices and received power difference.


title: Timestamping Documents and Beliefs

abstract: Most of the textual information available to us are temporally variable. In a world where information is dynamic, time-stamping them is a very important task. Documents are a good source of information and are used for many tasks like, sentiment analysis, classification of reviews etc. The knowledge of creation date of documents facilitates several tasks like summarization, event extraction, temporally focused information extraction etc. Unfortunately, for most of the documents on the web, the time-stamp meta-data is either erroneous or missing. Thus document dating is a challenging problem which requires inference over the temporal structure of the document alongside the contextual information of the document. Prior document dating systems have largely relied on handcrafted features while ignoring such document-internal structures. In this paper we propose NeuralDater, a Graph Convolutional Network (GCN) based document dating approach which jointly exploits syntactic and temporal graph structures of document in a principled way. We also pointed out some limitations of NeuralDater and tried to utilize both context and temporal information in documents in a more flexible and intuitive manner proposing AD3: Attentive Deep Document Dater, an attention-based document dating system. To the best of our knowledge these are the first application of deep learning methods for the task. Through extensive experiments on real-world datasets, we find that our models significantly outperforms state-of-the-art baselines by a significant margin.


title: Polyconvex anisotropic hyperelasticity with neural networks

abstract: In the present work, two machine learning based constitutive models for finite deformations are proposed. Using input convex neural networks, the models are hyperelastic, anisotropic and fulfill the polyconvexity condition, which implies ellipticity and thus ensures material stability. The first constitutive model is based on a set of polyconvex, anisotropic and objective invariants. The second approach is formulated in terms of the deformation gradient, its cofactor and determinant, uses group symmetrization to fulfill the material symmetry condition, and data augmentation to fulfill objectivity approximately. The extension of the dataset for the data augmentation approach is based on mechanical considerations and does not require additional experimental or simulation data. The models are calibrated with highly challenging simulation data of cubic lattice metamaterials, including finite deformations and lattice instabilities. A moderate amount of calibration data is used, based on deformations which are commonly applied in experimental investigations. While the invariant-based model shows drawbacks for several deformation modes, the model based on the deformation gradient alone is able to reproduce and predict the effective material behavior very well and exhibits excellent generalization capabilities. In addition, the models are calibrated with transversely isotropic data, generated with an analytical polyconvex potential. For this case, both models show excellent results, demonstrating the straightforward applicability of the polyconvex neural network constitutive models to other symmetry groups.


title: Key Information Extraction From Documents: Evaluation And Generator

abstract: Extracting information from documents usually relies on natural language processing methods working on one-dimensional sequences of text. In some cases, for example, for the extraction of key information from semi-structured documents, such as invoice-documents, spatial and formatting information of text are crucial to understand the contextual meaning. Convolutional neural networks are already common in computer vision models to process and extract relationships in multidimensional data. Therefore, natural language processing models have already been combined with computer vision models in the past, to benefit from e.g. positional information and to improve performance of these key information extraction models. Existing models were either trained on unpublished data sets or on an annotated collection of receipts, which did not focus on PDF-like documents. Hence, in this research project a template-based document generator was created to compare state-of-the-art models for information extraction. An existing information extraction model "Chargrid" (Katti et al., 2019) was reconstructed and the impact of a bounding box regression decoder, as well as the impact of an NLP pre-processing step was evaluated for information extraction from documents. The results have shown that NLP based pre-processing is beneficial for model performance. However, the use of a bounding box regression decoder increases the model performance only for fields that do not follow a rectangular shape.


title: AMU-EURANOVA at CASE 2021 Task 1: Assessing the stability of multilingual BERT

abstract: This paper explains our participation in task 1 of the CASE 2021 shared task. This task is about multilingual event extraction from news. We focused on sub-task 4, event information extraction. This sub-task has a small training dataset and we fine-tuned a multilingual BERT to solve this sub-task. We studied the instability problem on the dataset and tried to mitigate it.


title: Numerical optimization of loss system with retrial phenomenon in cellular networks

abstract: In this study, we extend upon the model by Haring et al. (2001) by introducing retrial phenomenon in multi-server queueing system. When at most g number of guard channels are available, it allows new calls to join the retrial group. This retrial group is called orbit and can hold a maximum of m retrial calls. The impact of retrial over certain performance measures is numerically investigated. The focus of this work is to construct optimization problems to determine the optimal number of channels, the optimal number of guard channels and the optimal orbit size. Further, it has been emphasized that the proposed model with retrial phenomenon reduces the blocking probability of new calls in the system.


title: Electron Energy Distributions in the Extended Gas Nebulae associated with High-z AGN: Maxwell-Boltzmann vs. kappa distributions

abstract: Emission line observations together with photoionization models provide important information about the ionization mechanisms, densities, temperatures, and metallicities in AGN-ionized gas. Photoionization models usually assume Maxwell-Boltzmann (M-B) electron energy distributions (EED), but it has been suggested that using kappa distributions may be more appropriate and could potentially solve the discrepancies in temperatures and abundances found in HII regions and Planetary Nebulae (PNe). We consider the impact of the presence of kappa distributions in photoionized nebulae associated with AGN and study how this might affect spectral modelling and abundance analyses for such regions. Using the photoionization code MAPPINGS 1e we compute models adopting M-B and kappa distributions of electron energies, and compare the behaviour of emission line ratios for different values of kappa, gas metallicity, density, ionization parameter and SED slope. We find that the choice of EED can have a large impact on some UV and optical emission lines emitted by photoionized nebulae associated with AGN, and that the impact of adopting a kappa distribution is strongly dependent on gas metallicity and ionization parameter. We compile a sample of line ratios for 143 type 2 AGN and compare our models against the observed line ratios. We find that for 98 objects kappa distributions provide a better fit to the observed line ratios than M-B distributions. In addition, we find that adopting kappa-distributed electron energies results in significant changes in the inferred gas metallicity and ionization parameter in a significant fraction of objects.


title: Topological Micromotion of Floquet Quantum Systems

abstract: The Floquet Hamiltonian has often been used to describe a time-periodic system. Nevertheless, because the Floquet Hamiltonian depends on a micro-motion parameter, the Floquet Hamiltonian with a fixed micro-motion parameter cannot faithfully represent a driven system, which manifests as the anomalous edge states. Here we show that an accurate description of a Floquet system requires a set of Hamiltonian exhausting all values of the micro-motion parameter, and this micro-motion parameter can be viewed as an extra synthetic dimension of the system. Therefore, we show that a $d$-dimensional Floquet system can be described by a $d+1$-dimensional static Hamiltonian, and the advantage of this representation is that the periodic boundary condition is automatically imposed along the extra-dimension, which enables a straightforward definition of topological invariants. The topological invariant in the $d+1$-dimensional system can ensure a $d-1$-dimensional edge state of the $d$-dimensional Floquet system. Here we show two examples where the topological invariant is a three-dimensional Hopf invariant. We highlight that our scheme of classifying Floquet topology on the micro-motion space is different from the previous classification of Floquet topology on the time space.


title: Quadratic first integrals of time-dependent dynamical systems of the form $\ddot{q}^{a}= -\Gamma^{a}_{bc}\dot{q}^{b} \dot{q}^{c} -\omega(t)Q^{a}(q)$

abstract: We consider the time-dependent dynamical system $\ddot{q}^{a}= -\Gamma_{bc}^{a}\dot{q}^{b}\dot{q}^{c}-\omega(t)Q^{a}(q)$ where $\omega(t)$ is a non-zero arbitrary function and the connection coefficients $\Gamma^{a}_{bc}$ are computed from the kinetic metric (kinetic energy) of the system. In order to determine the quadratic first integrals (QFIs) $I$ we assume that $I=K_{ab}\dot{q}^{a} \dot{q}^{b} +K_{a}\dot{q}^{a}+K$ where the unknown coefficients $K_{ab}, K_{a}, K$ are tensors depending on $t, q^{a}$ and impose the condition $\frac{dI}{dt}=0$. This condition leads to a system of partial differential equations (PDEs) involving the quantities $K_{ab}, K_{a}, K,$ $\omega(t)$ and $Q^{a}(q)$. From these PDEs, it follows that $K_{ab}$ is a Killing tensor (KT) of the kinetic metric. We use the KT $K_{ab}$ in two ways: a. We assume a general polynomial form in $t$ both for $K_{ab}$ and $K_{a}$; b. We express $K_{ab}$ in a basis of the KTs of order 2 of the kinetic metric assuming the coefficients to be functions of $t$. In both cases, this leads to a new system of PDEs whose solution requires that we specify either $\omega(t)$ or $Q^{a}(q)$. We consider first that $\omega(t)$ is a general polynomial in $t$ and find that in this case the dynamical system admits two independent QFIs which we collect in a Theorem. Next, we specify the quantities $Q^{a}(q)$ to be the generalized time-dependent Kepler potential $V=-\frac{\omega (t)}{r^{\nu}}$ and determine the functions $\omega(t)$ for which QFIs are admitted. We extend the discussion to the non-linear differential equation $\ddot{x}=-\omega(t)x^{\mu }+\phi (t)\dot{x}$ $(\mu \neq -1)$ and compute the relation between the coefficients $\omega(t), \phi(t)$ so that QFIs are admitted. We apply the results to determine the QFIs of the generalized Lane-Emden equation.


title: Improved Prediction and Network Estimation Using the Monotone Single Index Multi-variate Autoregressive Model

abstract: Network estimation from multi-variate point process or time series data is a problem of fundamental importance. Prior work has focused on parametric approaches that require a known parametric model, which makes estimation procedures less robust to model mis-specification, non-linearities and heterogeneities. In this paper, we develop a semi-parametric approach based on the monotone single-index multi-variate autoregressive model (SIMAM) which addresses these challenges. We provide theoretical guarantees for dependent data and an alternating projected gradient descent algorithm. Significantly we do not explicitly assume mixing conditions on the process (although we do require conditions analogous to restricted strong convexity) and we achieve rates of the form $O(T^{-\frac{1}{3}} \sqrt{s\log(TM)})$ (optimal in the independent design case) where $s$ is the threshold for the maximum in-degree of the network that indicates the sparsity level, $M$ is the number of actors and $T$ is the number of time points. In addition, we demonstrate the superior performance both on simulated data and two real data examples where our SIMAM approach out-performs state-of-the-art parametric methods both in terms of prediction and network estimation.


title: Blockchain and AI-based Solutions to Combat Coronavirus (COVID-19)-like Epidemics: A Survey

abstract: The beginning of 2020 has seen the emergence of coronavirus outbreak caused by a novel virus called SARS-CoV-2. The sudden explosion and uncontrolled worldwide spread of COVID-19 show the limitations of existing healthcare systems in timely handling public health emergencies. In such contexts, innovative technologies such as blockchain and Artificial Intelligence (AI) have emerged as promising solutions for fighting coronavirus epidemic. In particular, blockchain can combat pandemics by enabling early detection of outbreaks, ensuring the ordering of medical data, and ensuring reliable medical supply chain during the outbreak tracing. Moreover, AI provides intelligent solutions for identifying symptoms caused by coronavirus for treatments and supporting drug manufacturing. Therefore, we present an extensive survey on the use of blockchain and AI for combating COVID-19 epidemics. First, we introduce a new conceptual architecture which integrates blockchain and AI for fighting COVID-19. Then, we survey the latest research efforts on the use of blockchain and AI for fighting COVID-19 in various applications. The newly emerging projects and use cases enabled by these technologies to deal with coronavirus pandemic are also presented. A case study is also provided using federated AI for COVID-19 detection. Finally, we point out challenges and future directions that motivate more research efforts to deal with future coronavirus-like epidemics.


title: Optical and excitonic properties of transition metal oxide perovskites by the Bethe-Salpeter equation

abstract: We present a systematic investigation of the role and importance of excitonic effects on the optical properties of transitions metal oxide perovskites. A representative set of fourteen compounds has been selected, including 3$d$ (SrTiO$_3$, LaScO$_3$, LaTiO$_3$, LaVO$_3$, LaCrO$_3$, LaMnO$_3$, LaFeO$_3$ and SrMnO$_3$), 4$d$ (SrZrO$_3$, SrTcO$_3$ and Ca$_2$RuO$_4$) and 5$d$ (SrHfO$_3$, KTaO$_3$ and NaOsO$_3$) perovskites, covering a band gap ranging from 0.1 eV to 6.1 eV and exhibiting different electronic, structural and magnetic properties. Optical conductivities and optical transitions including electron-hole interactions are calculated through the solution of the Bethe-Salpeter equation (BSE) with quasi-particle energies evaluated by single-shot $G_0W_0$ approximation. The exciton binding energies are computed by means of a model-BSE (mBSE), carefully benchmarked against the full BSE method, in order to obtain well-converged results in terms of k-point sampling. The predicted results are compared with available measured data, with an overall satisfactory agreement between theory and experiment.


title: Local Whittle estimation with (quasi-)analytic wavelets

abstract: In the general setting of long-memory multivariate time series, the long-memory characteristics are defined by two components. The long-memory parameters describe the autocorrelation of each time series. And the long-run covariance measures the coupling between time series, with general phase parameters. It is of interest to estimate the long-memory, long-run covariance and general phase parameters of time series generated by this wide class of models although they are not necessarily Gaussian nor stationary. This estimation is thus not directly possible using real wavelets decomposition or Fourier analysis. Our purpose is to define an inference approach based on a representation using quasi-analytic wavelets. We first show that the covariance of the wavelet coefficients provides an adequate estimator of the covariance structure including the phase term. Consistent estimators based on a local Whittle approximation are then proposed. Simulations highlight a satisfactory behavior of the estimation on finite samples on linear time series and on multivariate fractional Brownian motions. An application on a real neuroscience dataset is presented, where long-memory and brain connectivity are inferred.


title: Algebraic Topology for Data Analysis

abstract: This research addresses a new tool for data analysis known as Topological Data Analysis TDA It underlies an area of Mathematics known as Combinatorial Algebra or more recently Algebraic Topology which through making strong use of Computation Statistics Probability and Topology among other concepts extracts mathematical characteristics from a set of data that allow us associate create and infer general and quality information about them


title: Rao distances and Conformal Mapping

abstract: In this article, we have described the Rao distance (due to C.R. Rao) and ideas of conformal mappings on 3D objects with angle preservations. Three propositions help us to construct distances between the points within the 3D objects in \mathbb{R}^{3} and line integrals within complex planes. We highlight the application of these concepts to virtual tourism.


title: Asymptotic Degradation of Linear Regression Estimates With Strategic Data Sources

abstract: We consider the problem of linear regression from strategic data sources with a public good component, i.e., when data is provided by strategic agents who seek to minimize an individual provision cost for increasing their data's precision while benefiting from the model's overall precision. In contrast to previous works, our model tackles the case where there is uncertainty on the attributes characterizing the agents' data -- a critical aspect of the problem when the number of agents is large. We provide a characterization of the game's equilibrium, which reveals an interesting connection with optimal design. Subsequently, we focus on the asymptotic behavior of the covariance of the linear regression parameters estimated via generalized least squares as the number of data sources becomes large. We provide upper and lower bounds for this covariance matrix and we show that, when the agents' provision costs are superlinear, the model's covariance converges to zero but at a slower rate relative to virtually all learning problems with exogenous data. On the other hand, if the agents' provision costs are linear, this covariance fails to converge. This shows that even the basic property of consistency of generalized least squares estimators is compromised when the data sources are strategic.


title: Computing Characteristic Polynomials of p-Curvatures in Average Polynomial Time

abstract: We design a fast algorithm that computes, for a given linear differential operator with coefficients in $Z[x ]$, all the characteristic polynomials of its p-curvatures, for all primes $p < N$ , in asymptotically quasi-linear bit complexity in N. We discuss implementations and applications of our algorithm. We shall see in particular that the good performances of our algorithm are quickly visible.


title: Rate and Power Adaptation for Multihop Regenerative Relaying Systems

abstract: In this work, we provide a global framework analysis of a multi-hop relaying systems wherein the transmitter (TX) communicates with the receiver (RX) through a set of intermediary relays deployed either in series or in parallel. Regenerative based relaying scheme is assumed such as the repetition-coded decoded-and-forward (DF) wherein the decoding is threshold-based. To reflect a wide range of fading, we introduce the generalized $H$-function (also termed as Fox-$H$ function) distribution model which enables the modeling of radio-frequency (RF) fading like Weibull and Gamma, as well as the free-space optic (FSO) such as the Double Generalized Gamma and M\'alaga fading. In this context, we introduce various power and rate adaptation policies based on the channel state information (CSI) availability at TX and RX. Finally, we address the effects of relaying topology, number of relays and fading model, etc, on the performance reliability of each link adaptation policy.


title: Adaptive phase-retrieval stochastic reconstruction with correlation functions: 3D images from 2D cuts

abstract: Precise characterization of three-dimensional heterogeneous media is indispensable in finding the relationships between structure and macroscopic physical properties (permeability, conductivity, and others). The most widely used experimental methods (electronic and optical microscopy) provide high-resolution bi-dimensional images of the samples of interest. However, 3D material inner microstructure registration is needed to apply numerous modeling tools. Numerous research areas search for cheap and robust methods to obtain "full" 3D information about the structure of the studied sample from its 2D cuts. In this work, we develop a dynamic phase-retrieval stochastic reconstruction algorithm that can create 3D replicas from 2D original images - DDTF. The DDTF is free of artifacts characteristic of previously proposed phase-retrieval techniques. While based on a two-point $S_2$ correlation function, any correlation function or other morphological metrics can be accounted for during the reconstruction, thus, paving the way to the hybridization of different reconstruction techniques. In this work, we use two-point probability and surface-surface functions for optimization. To test DDTF, we performed reconstructions for three binary porous media samples of different genesis: sandstone, carbonate, and ceramic. Based on computed permeability and connectivity ($C_2$ and $L_2$ correlation functions), we have shown that the proposed technique in terms of accuracy is comparable to the classic simulated annealing-based reconstruction method but is computationally very effective. Our findings open the possibility of utilizing DDTF to produce fast or crude replicas further polished by other reconstruction techniques such as simulated annealing or process-based methods.


title: Homogeneous Nucleation of Sheared Liquids: Advances and Insights from Simulations and Theory

abstract: One of the most ubiquitous and technologically important phenomena in nature is the nucleation of homogeneous flowing systems. The microscopic effects of shear on a nucleating system are still imperfectly understood, although in recent years a consistent picture has emerged. The opposing effects of shear can be split into two major contributions for simple liquids: increase of the energetic cost of nucleation, and enhancement of the kinetics. In this perspective, we describe the latest computational and theoretical techniques which have been developed over the past two decades. We collate and unify the overarching influences of shear, temperature, and supersaturation on the process of homogeneous nucleation. Experimental techniques and capabilities are discussed, against the backdrop of results from simulations and theory. Although we primarily focus on simple liquids, we also touch upon the sheared nucleation of more complex systems, including glasses and polymer melts. We speculate on the promising directions and possible advances that could come to fruition in the future.


title: Pre-treatment of outliers and anomalies in plant data: Methodology and case study of a Vacuum Distillation Unit

abstract: Data pre-treatment plays a significant role in improving data quality, thus allowing extraction of accurate information from raw data. One of the data pre-treatment techniques commonly used is outliers detection. The so-called 3${\sigma}$ method is a common practice to identify the outliers. As shown in the manuscript, it does not identify all outliers, resulting in possible distortion of the overall statistics of the data. This problem can have a significant impact on further data analysis and can lead to reduction in the accuracy of predictive models. There is a plethora of various techniques for outliers detection, however, aside from theoretical work, they all require case study work. Two types of outliers were considered: short-term (erroneous data, noise) and long-term outliers (e.g. malfunctioning for longer periods). The data used were taken from the vacuum distillation unit (VDU) of an Asian refinery and included 40 physical sensors (temperature, pressure and flow rate). We used a modified method for 3${\sigma}$ thresholds to identify the short-term outliers, i.e. ensors data are divided into chunks determined by change points and 3${\sigma}$ thresholds are calculated within each chunk representing near-normal distribution. We have shown that piecewise 3${\sigma}$ method offers a better approach to short-term outliers detection than 3${\sigma}$ method applied to the entire time series. Nevertheless, this does not perform well for long-term outliers (which can represent another state in the data). In this case, we used principal component analysis (PCA) with Hotelling's $T^2$ statistics to identify the long-term outliers. The results obtained with PCA were subject to DBSCAN clustering method. The outliers (which were visually obvious and correctly detected by the PCA method) were also correctly identified by DBSCAN which supported the consistency and accuracy of the PCA method.


title: Expert Q-learning: Deep Reinforcement Learning with Coarse State Values from Offline Expert Examples

abstract: In this article, we propose a novel algorithm for deep reinforcement learning named Expert Q-learning. Expert Q-learning is inspired by Dueling Q-learning and aims at incorporating semi-supervised learning into reinforcement learning through splitting Q-values into state values and action advantages. We require that an offline expert assesses the value of a state in a coarse manner using three discrete values. An expert network is designed in addition to the Q-network, which updates each time following the regular offline minibatch update whenever the expert example buffer is not empty. Using the board game Othello, we compare our algorithm with the baseline Q-learning algorithm, which is a combination of Double Q-learning and Dueling Q-learning. Our results show that Expert Q-learning is indeed useful and more resistant to the overestimation bias. The baseline Q-learning algorithm exhibits unstable and suboptimal behavior in non-deterministic settings, whereas Expert Q-learning demonstrates more robust performance with higher scores, illustrating that our algorithm is indeed suitable to integrate state values from expert examples into Q-learning.


title: Privacy-Utility Trade-Offs Against Limited Adversaries

abstract: We study privacy-utility trade-offs where users share privacy-correlated useful information with a service provider to obtain some utility. The service provider is adversarial in the sense that it can infer the users' private information based on the shared useful information. To minimize the privacy leakage while maintaining a desired level of utility, the users carefully perturb the useful information via a probabilistic privacy mapping before sharing it. We focus on the setting in which the adversary attempting an inference attack on the users' privacy has potentially biased information about the statistical correlation between the private and useful variables. This information asymmetry between the users and the limited adversary leads to better privacy guarantees than the case of the omniscient adversary under the same utility requirement. We first identify assumptions on the adversary's information so that the inference costs are well-defined and finite. Then, we characterize the impact of the information asymmetry and show that it increases the inference costs for the adversary. We further formulate the design of the privacy mapping against a limited adversary using a difference of convex functions program and solve it via the concave-convex procedure. When the adversary's information is not precisely available, we adopt a Bayesian view and represent the adversary's information by a probability distribution. In this case, the expected cost for the adversary does not admit a closed-form expression, and we establish and maximize a lower bound of the expected cost. We provide a numerical example regarding a census data set to illustrate the theoretical results.


title: Asymptotic Log-Det Rank Minimization via (Alternating) Iteratively Reweighted Least Squares

abstract: The affine rank minimization (ARM) problem is well known for both its applications and the fact that it is NP-hard. One of the most successful approaches, yet arguably underrepresented, is iteratively reweighted least squares (IRLS), more specifically $\mathrm{IRLS}$-$0$. Despite comprehensive empirical evidence that it overall outperforms nuclear norm minimization and related methods, it is still not understood to a satisfying degree. In particular, the significance of a slow decrease of the therein appearing regularization parameter denoted $\gamma$ poses interesting questions. While commonly equated to matrix recovery, we here consider the ARM independently. We investigate the particular structure and global convergence property behind the asymptotic minimization of the log-det objective function on which $\mathrm{IRLS}$-$0$ is based. We expand on local convergence theorems, now with an emphasis on the decline of $\gamma$, and provide representative examples as well as counterexamples such as a diverging $\mathrm{IRLS}$-$0$ sequence that clarify theoretical limits. We present a data sparse, alternating realization $\mathrm{AIRLS}$-$p$ (related to prior work under the name $\mathrm{SALSA}$) that, along with the rest of this work, serves as basis and introduction to the more general tensor setting. In conclusion, numerical sensitivity experiments are carried out that reconfirm the success of $\mathrm{IRLS}$-$0$ and demonstrate that in surprisingly many cases, a slower decay of $\gamma$ will yet lead to a solution of the ARM problem, up to the point that the exact theoretical phase transition for generic recoverability can be observed. Likewise, this suggests that non-convexity is less substantial and problematic for the log-det approach than it might initially appear.


title: Compact stellar models in modified gravity

abstract: In the present investigation compact stellar models are dealt with in the framework of the modified gravity theory, specifically of $f(\mathbb{T},\mathcal{T})$ type. We have considered that the compact objects are following a spherically symmetric static metric and obtained the Einstein field equations in the spacetime of $f(\mathbb{T},\mathcal{T})$. To make the Einstein equations solvable we employ the methodology of conformal Killing vectors. Thereafter by using the MIT bag equation of state to the compact stars, considering that the stars are formed by strange quark, we find the solutions set. The solutions are examined via several physical tastings which exhibit viability of the model.