title: On convergence of the cavity and Bolthausen's TAP iterations to the local magnetization

abstract: The cavity and TAP equations are high-dimensional systems of nonlinear equations of the local magnetization in the Sherrington-Kirkpatrick model. In the seminal work [Comm. Math. Phys., 325(1):333-366, 2014], Bolthausen introduced an iterative scheme that produces an asymptotic solution to the TAP equations if the model lies inside the Almeida-Thouless transition line. However, it was unclear if this asymptotic solution coincides with the local magnetization. In this work, motivated by the cavity equations, we introduce a new iterative scheme and establish a weak law of large numbers. We show that our new scheme is asymptotically the same as the so-called Approximate Message Passing algorithm, a generalization of Bolthausen's iteration, that has been popularly adapted in compressed sensing, Bayesian inferences, etc. Based on this, we confirm that our cavity iteration and Bolthausen's scheme both converge to the local magnetization as long as the overlap is locally uniformly concentrated.


title: Generating Correct Answers for Progressive Matrices Intelligence Tests

abstract: Raven's Progressive Matrices are multiple-choice intelligence tests, where one tries to complete the missing location in a $3\times 3$ grid of abstract images. Previous attempts to address this test have focused solely on selecting the right answer out of the multiple choices. In this work, we focus, instead, on generating a correct answer given the grid, without seeing the choices, which is a harder task, by definition. The proposed neural model combines multiple advances in generative models, including employing multiple pathways through the same network, using the reparameterization trick along two pathways to make their encoding compatible, a dynamic application of variational losses, and a complex perceptual loss that is coupled with a selective backpropagation procedure. Our algorithm is able not only to generate a set of plausible answers, but also to be competitive to the state of the art methods in multiple-choice tests.


title: A novel receiver design for energy packet-based dispatching

abstract: A steadily growing share of renewable energies with uctuating and decentralized generation as well as rising peak loads require novel solutions to ensure the reliability of electricity supply. More speci cally, grid stability is endangered by equally relevant line constraints and battery capacity limits. In this light, energy packet-based dispatching with power signal dual modulation has recently been introduced as an innovative solution. However, this approach assumes a central synchronicity provision unit for energy packet dispatching. In order to overcome this assumption, the present paper's main contribution is a design of an energy packet receiver which recovers the required synchronicity information directly from the received signal itself. Key implementation aspects are discussed in detail. By means of a DC grid example, simulation results show the performance and applicability of the proposed novel receiver for packet-based energy dispatching.


title: Price of Anarchy of Simple Auctions with Interdependent Values

abstract: We expand the literature on the price of anarchy (PoA) of simultaneous item auctions by considering settings with correlated values; we do this via the fundamental economic model of interdependent values (IDV). It is well-known that in multi-item settings with private values, correlated values can lead to bad PoA, which can be polynomially large in the number of agents $n$. In the more general model of IDV, we show that the PoA can be polynomially large even in single-item settings. On the positive side, we identify a natural condition on information dispersion in the market, termed $\gamma$-heterogeneity, which enables good PoA guarantees. Under this condition, we show that for single-item settings, the PoA of standard mechanisms degrades gracefully with $\gamma$. For settings with $m>1$ items we show a separation between two domains: If $n \geq m$, we devise a new simultaneous item auction with good PoA (with respect to $\gamma$), under limited information asymmetry. To the best of our knowledge, this is the first positive PoA result for correlated values in multi-item settings. The main technical difficulty in establishing this result is that the standard tool for establishing PoA results -- the smoothness framework -- is unsuitable for IDV settings, and so we must introduce new techniques to address the unique challenges imposed by such settings. In the domain of $n \ll m$, we establish impossibility results even for surprisingly simple scenarios.


title: The Concept of Entropic Time: A Preliminary Discussion

abstract: The deep connection between entropy and information is discussed in terms of both classical and quantum physics. The mechanism of information transfer between systems via entanglement is explored in the context of decoherence theory. The concept of entropic time is then introduced on the basis of information acquisition, which is argued to be effectively irreversible and consistent with both the Second Law of Thermodynamics and our psychological perception of time. This is distinguished from the notion of parametric time, which serves as the temporal parameter for the unitary evolution of a physical state in non-relativistic quantum mechanics. The atemporal nature of the `collapse' of the state vector associated with such information gain is discussed in light of relativistic considerations. The interpretation of these ideas in terms of both subjective and objective collapse models is also discussed. It is shown that energy is conserved under subjective collapse schemes whereas, in general, under objective collapse it is not. This is consistent with the fact that the latter is inherently non-unitary and that energy conservation arises out of time symmetry in the first place.


title: The MATLAS survey of faint outskirts of bright galaxies

abstract: Deep imaging, that is imaging capable of capturing very low surface brightness extended objects, is a quickly growing field of extragalactic astronomy. Not only can new types of faint objects be discovered, but deep images of bright galaxies are very valuable, too, since they reveal faint signs of past galaxy collisions, the tidal features. Such "archeological" record can be exploited for investigating how galaxies formed. In the MATLAS survey, we obtained extremely deep images of 177 nearby massive elliptical and lenticular galaxies using the 3.5m Canada-France-Hawaii Telescope. In our contribution, we will present the various types of objects and features seen in our images, for example tidal features, faint star-forming regions in otherwise quenched galaxies, or faint dust clouds in our own Galaxy. Finally, we will introduce the deep-imaging efforts at the Milankovi\'c Telescope.


title: Poisson Structures on Finitary Incidence Algebras

abstract: We give a full description of the Poisson structures on the finitary incidence algebra $FI(P,R)$ of an arbitrary poset $P$ over a commutative unital ring $R$.


title: Focusing Phenomena in Linear Discrete Inverse Problems in Acoustics

abstract: The focusing operation inherent to the linear discrete inverse problem is formalised. The development is given in the context of sound-field reproduction where the source strengths are the inverse solution needed to recreate a prescribed pressure field at discrete locations. The behaviour of the system is fundamentally tied to the amount of acoustic crosstalk at each control point as a result of the focusing operation inherent to the pseudoinverse. The maximisation of the crosstalk at just one point leads to linear dependence in the system. On the other hand, its minimisation leads to the ideal focusing state wherein the sources can selectively focus at each point, while a null is created at all other points. Two theoretical case studies are presented that demonstrate ideal and super ideal focusing, wherein the latter the condition number is unitary. First, the application of binaural audio reproduction using an array of loudspeakers is examined and several cases of ideal focusing are presented. In the process, the Optimal Source Distribution is re-derived and shown to be a case of super ideal focusing. Secondly, the application of recreating multiple sound zones is examined using a uniform linear array. The conditions are derived to achieve ideal focusing at control points positioned arbitrarily in the far-field. In all cases, the ability to maintain ideal focusing as a function of frequency requires proportional changes in the source or control point geometry.


title: A Lower Bound for Dynamic Fractional Cascading

abstract: We investigate the limits of one of the fundamental ideas in data structures: fractional cascading. This is an important data structure technique to speed up repeated searches for the same key in multiple lists and it has numerous applications. Specifically, the input is a "catalog" graph, $G$, of constant degree together with a list of values assigned to every vertex of $G$. The goal is to preprocess the input such that given a connected subgraph $H$ of $G$ and a single query value $q$, one can find the predecessor of $q$ in every list that belongs to $\scat$. The classical result by Chazelle and Guibas shows that in a pointer machine, this can be done in the optimal time of $\O(\log n + |\scat|)$ where $n$ is the total number of values. However, if insertion and deletion of values are allowed, then the query time slows down to $\O(\log n + |\scat| \log\log n)$. If only insertions (or deletions) are allowed, then once again, an optimal query time can be obtained but by using amortization at update time. We prove a lower bound of $\Omega( \log n \sqrt{\log\log n})$ on the worst-case query time of dynamic fractional cascading, when queries are paths of length $O(\log n)$. The lower bound applies both to fully dynamic data structures with amortized polylogarithmic update time and incremental data structures with polylogarithmic worst-case update time. As a side, this also roves that amortization is crucial for obtaining an optimal incremental data structure. This is the first non-trivial pointer machine lower bound for a dynamic data structure that breaks the $\Omega(\log n)$ barrier. In order to obtain this result, we develop a number of new ideas and techniques that hopefully can be useful to obtain additional dynamic lower bounds in the pointer machine model.


title: QCD in the heavy dense regime: Large $N_c$ and quarkyonic matter

abstract: After combined character and hopping expansions and integration over the spatial gauge links, lattice QCD reduces to a three-dimensional $SU(3)$ Polyakov loop model with complicated interactions. A simple truncation of the effective theory is valid for heavy quarks on reasonably fine lattices and can be solved by linked cluster expansion in its effective couplings. This was used ealier to demonstrate the onset transition to baryon matter in the cold and dense regime. Repeating these studies for general $N_c$, one finds that for large $N_c$ the onset transition becomes first-order, and the pressure scales as $p\sim N_c$ through three consecutive orders in the hoppoing expansion. These features are consistent with the formal definition of quarkyonic matter given in the literature. We discuss the implications for $N_c=3$ and physical QCD.


title: De-localizing brittle fracture

abstract: Extreme localization of damage in conventional brittle materials is the source of a host of undesirable effects. We show how artificially engineered metamaterials with all brittle constituents can be designed to ensure that every breakable sub-element fails independently. The main role in the proposed design is played by high contrast composite sub-structure with zero-stiffness, furnishing nonlocal stress redistribution. The ability to de-localize cracking in such nominally brittle systems is revealed by the fact that their continuum description is dominated by the gradient (bending) rather than classical (stretching) elasticity. By engineering a crossover from brittle to effectively ductile (quasi-brittle) behavior in prototypical systems of this type, we reveal the structural underpinning behind the difference between fracture and damage.


title: Joint Tracking of Multiple Beams in Beamspace MIMO Systems

abstract: In millimeter-wave (mmWave) systems, beamforming is needed to overcome harsh channel environments. As a promising beamforming solution, lens antenna array (LAA) implementation can provide a cost-effective solution without notable performance degradation compared to its counterpart. However, an appropriate beam selection is a challenge since it requires efficient channel estimation via an extensive beam training process for perfect beam alignment. In this paper, we propose a high mobility beam and channel tracking algorithm based on the unscented Kalman filter (UKF) to address this challenge, where the channel changes can be monitored over a certain time. The proposed algorithm tracks the channel changes after establishing a connection with an appropriate beam. The algorithm is first introduced in a multi-user beamspace multiple-input multiple-output (MIMO) system with LAA where a single beam is tracked at the user side at downlink transmission. Then, it is employed for multi-beam joint-tracking at the base station side in the uplink transmission. The analysis indicates that under different channel variation conditions, the proposed algorithm outmatches the popular extended Kalman filter (EKF) in both single-beam and multi-beam tracking systems. While it is common to individually track the beams in a multi-beam system scenario, the proposed joint tracking approach can provide around 62% performance enhancement compared to individual beam tracking using the conventional EKF method.


title: On the Reflectivity of 128 nm Photons Off Stainless Steel

abstract: This investigation presents a new experimental determination of the reflectivity of 128 nm scintillation photons off stainless steel. The experiment took place in the TallBo dewar facility at Fermilab. The data were obtained using a detector that is sensitive to photons falling on its front face but is insensitive to photons falling on its back face or its sides. By comparing the ratio of photons per track from tracks that illuminate the front face of the detector to those that cross the back side with a simulation of the experiment where the reflectivity can be varied, a value of the reflectivity was determined. The reflectivity for the SA-240-304L stainless steel alloy off which the scintillation photons reflect in the TallBo dewar as found by this experiment is R = 0.674 +/- 0.038. The experiment is not sensitive to the differences between specular and diffuse reflections.


title: Polymer Informatics: Current Status and Critical Next Steps

abstract: Artificial intelligence (AI) based approaches are beginning to impact several domains of human life, science and technology. Polymer informatics is one such domain where AI and machine learning (ML) tools are being used in the efficient development, design and discovery of polymers. Surrogate models are trained on available polymer data for instant property prediction, allowing screening of promising polymer candidates with specific target property requirements. Questions regarding synthesizability, and potential (retro)synthesis steps to create a target polymer, are being explored using statistical means. Data-driven strategies to tackle unique challenges resulting from the extraordinary chemical and physical diversity of polymers at small and large scales are being explored. Other major hurdles for polymer informatics are the lack of widespread availability of curated and organized data, and approaches to create machine-readable representations that capture not just the structure of complex polymeric situations but also synthesis and processing conditions. Methods to solve inverse problems, wherein polymer recommendations are made using advanced AI algorithms that meet application targets, are being investigated. As various parts of the burgeoning polymer informatics ecosystem mature and become integrated, efficiency improvements, accelerated discoveries and increased productivity can result. Here, we review emergent components of this polymer informatics ecosystem and discuss imminent challenges and opportunities.


title: PILOT: Efficient Planning by Imitation Learning and Optimisation for Safe Autonomous Driving

abstract: Achieving a proper balance between planning quality, safety and efficiency is a major challenge for autonomous driving. Optimisation-based motion planners are capable of producing safe, smooth and comfortable plans, but often at the cost of runtime efficiency. On the other hand, naively deploying trajectories produced by efficient-to-run deep imitation learning approaches might risk compromising safety. In this paper, we present PILOT -- a planning framework that comprises an imitation neural network followed by an efficient optimiser that actively rectifies the network's plan, guaranteeing fulfilment of safety and comfort requirements. The objective of the efficient optimiser is the same as the objective of an expensive-to-run optimisation-based planning system that the neural network is trained offline to imitate. This efficient optimiser provides a key layer of online protection from learning failures or deficiency in out-of-distribution situations that might compromise safety or comfort. Using a state-of-the-art, runtime-intensive optimisation-based method as the expert, we demonstrate in simulated autonomous driving experiments in CARLA that PILOT achieves a seven-fold reduction in runtime when compared to the expert it imitates without sacrificing planning quality.


title: Body coherence in curved-space virtual reality games

abstract: Virtual-reality simulations of curved space are most effective and most fun when presented as a game (for example, curved-space billiards), so the user not only has something to see in the curved space, but also has something fun to do there. However, such simulations encounter a geometrical problem: they must track the player's hands as well as her head, and in curved space the effects of holonomy would quickly lead to violations of "body coherence". That is, what the player sees with her eyes would disagree with what she feels with her hands. This article presents a solution to the body coherence problem, as well as several other questions that arise in interactive VR simulations in curved space (radians vs. meters, visualization of the projection transformation, native-inhabitant view vs. tourist view, and mental models of curved space).


title: Best Match Graphs with Binary Trees

abstract: Best match graphs (BMG) are a key intermediate in graph-based orthology detection and contain a large amount of information on the gene tree. We provide a near-cubic algorithm to determine whether a BMG is binary-explainable, i.e., whether it can be explained by a fully resolved gene tree and, if so, to construct such a tree. Moreover, we show that all such binary trees are refinements of the unique binary-resolvable tree (BRT), which in general is a substantial refinement of the also unique least resolved tree of a BMG. Finally, we show that the problem of editing an arbitrary vertex-colored graph to a binary-explainable BMG is NP-complete and provide an integer linear program formulation for this task.


title: Watermarking Graph Neural Networks by Random Graphs

abstract: Many learning tasks require us to deal with graph data which contains rich relational information among elements, leading increasing graph neural network (GNN) models to be deployed in industrial products for improving the quality of service. However, they also raise challenges to model authentication. It is necessary to protect the ownership of the GNN models, which motivates us to present a watermarking method to GNN models in this paper. In the proposed method, an Erdos-Renyi (ER) random graph with random node feature vectors and labels is randomly generated as a trigger to train the GNN to be protected together with the normal samples. During model training, the secret watermark is embedded into the label predictions of the ER graph nodes. During model verification, by activating a marked GNN with the trigger ER graph, the watermark can be reconstructed from the output to verify the ownership. Since the ER graph was randomly generated, by feeding it to a non-marked GNN, the label predictions of the graph nodes are random, resulting in a low false alarm rate (of the proposed work). Experimental results have also shown that, the performance of a marked GNN on its original task will not be impaired. Moreover, it is robust against model compression and fine-tuning, which has shown the superiority and applicability.


title: Full heavy dibaryons

abstract: The existence of full heavy dibaryons $\Omega_{ccc}\Omega_{bbb}$, $\Omega_{ccc}\Omega_{ccc}$ and $\Omega_{bbb}\Omega_{bbb}$ with $J=0,~1,~2,~3$ and $P=\pm1$ are investigated in the framework of a constituent quark model. The dibaryon composed of six $c$ or $b$ quarks with $J^{P}=0^{+}$ is possible to be bound, while the dibaryon with the $cccbbb$ configuration is difficult to form any bound state. We also study the interaction between two full heavy baryons, and the effective potentials, suggesting the existence of dibaryons $\Omega_{ccc}\Omega_{ccc}$ and $\Omega_{bbb}\Omega_{bbb}$, and the absence of binding for $\Omega_{ccc}\Omega_{bbb}$ system. Besides, the calculation of the low-energy scattering phase shifts of the $\Omega_{ccc}\Omega_{ccc}$ and $\Omega_{bbb}\Omega_{bbb}$, as well as the scattering length also confirm the existence of stable full heavy dibaryons $\Omega_{ccc}\Omega_{ccc}$ and $\Omega_{bbb}\Omega_{bbb}$.


title: Ultrahigh-speed optical coherence tomography based on a 100 MHz and 100 nm swept source

abstract: We demonstrate an ultrahigh-speed optical coherence tomography (OCT) based on a 100 MHz swept source (SS). An all polarization-maintaining figure-9 mode-locked fiber laser is used as the seed laser. After nonlinear spectral expansion in an Erbium-doped fiber amplifier, a flat top spectrum with respectively 1-dB and 10-dB bandwidths of 73.7 nm and 106 nm is obtained. The broadband femtosecond pulse is time stretched to a swept signal in a section of dispersion compensation fiber with a total dispersion of -84 ps/nm. With the swept source, the axial resolution of the SS-OCT is measured to be 21 um with a 6 dB sensitivity roll-off length of 3 mm. A tomographic image of an encoding disk and a hard disk jointly rotating at 17,000 rpm was acquired by using the SS-OCT with a high imaging quality.


title: On Signal-to-Noise Ratio Issues in Variational Inference for Deep Gaussian Processes

abstract: We show that the gradient estimates used in training Deep Gaussian Processes (DGPs) with importance-weighted variational inference are susceptible to signal-to-noise ratio (SNR) issues. Specifically, we show both theoretically and via an extensive empirical evaluation that the SNR of the gradient estimates for the latent variable's variational parameters decreases as the number of importance samples increases. As a result, these gradient estimates degrade to pure noise if the number of importance samples is too large. To address this pathology, we show how doubly reparameterized gradient estimators, originally proposed for training variational autoencoders, can be adapted to the DGP setting and that the resultant estimators completely remedy the SNR issue, thereby providing more reliable training. Finally, we demonstrate that our fix can lead to consistent improvements in the predictive performance of DGP models.


title: Mapping the charge-dyon system into the position-dependent effective mass background via Pauli equation

abstract: This work aims to reproduce a quantum system composed of a charged spin - $1/2$ fermion interacting with a dyon with an opposite electrical charge (charge-dyon system), utilizing a position-dependent effective mass (PDM) background in the non-relativistic regime via the PDM free Pauli equation. To investigate whether there is a PDM quantum system with the same physics (analogous model) that a charge-dyon system (target system), we resort to the PDM free Pauli equation itself. We proceed with replacing the exact bi-spinor of the target system into this equation, obtaining an uncoupled system of non-linear partial differential equations for the mass distribution $M$. We were able to solve them numerically for $M$ considering a radial dependence only, i.e., $M=M(r)$, fixing $\theta_0$, and considering specific values of $\mu$ and $m$ satisfying a certain condition. We present the solutions graphically, and from them, we determine the respective effective potentials, which actually represent our analogous models. We study the mapping for eigenvalues starting from the minimal value $j = \mu - 1/2$.


title: Ask Your Humans: Using Human Instructions to Improve Generalization in Reinforcement Learning

abstract: Complex, multi-task problems have proven to be difficult to solve efficiently in a sparse-reward reinforcement learning setting. In order to be sample efficient, multi-task learning requires reuse and sharing of low-level policies. To facilitate the automatic decomposition of hierarchical tasks, we propose the use of step-by-step human demonstrations in the form of natural language instructions and action trajectories. We introduce a dataset of such demonstrations in a crafting-based grid world. Our model consists of a high-level language generator and low-level policy, conditioned on language. We find that human demonstrations help solve the most complex tasks. We also find that incorporating natural language allows the model to generalize to unseen tasks in a zero-shot setting and to learn quickly from a few demonstrations. Generalization is not only reflected in the actions of the agent, but also in the generated natural language instructions in unseen tasks. Our approach also gives our trained agent interpretable behaviors because it is able to generate a sequence of high-level descriptions of its actions.


title: AI Marker-based Large-scale AI Literature Mining

abstract: The knowledge contained in academic literature is interesting to mine. Inspired by the idea of molecular markers tracing in the field of biochemistry, three named entities, namely, methods, datasets and metrics are used as AI markers for AI literature. These entities can be used to trace the research process described in the bodies of papers, which opens up new perspectives for seeking and mining more valuable academic information. Firstly, the entity extraction model is used in this study to extract AI markers from large-scale AI literature. Secondly, original papers are traced for AI markers. Statistical and propagation analysis are performed based on tracing results. Finally, the co-occurrences of AI markers are used to achieve clustering. The evolution within method clusters and the influencing relationships amongst different research scene clusters are explored. The above-mentioned mining based on AI markers yields many meaningful discoveries. For example, the propagation of effective methods on the datasets is rapidly increasing with the development of time; effective methods proposed by China in recent years have increasing influence on other countries, whilst France is the opposite. Saliency detection, a classic computer vision research scene, is the least likely to be affected by other research scenes.


title: CHIME: Cross-passage Hierarchical Memory Network for Generative Review Question Answering

abstract: We introduce CHIME, a cross-passage hierarchical memory network for question answering (QA) via text generation. It extends XLNet introducing an auxiliary memory module consisting of two components: the context memory collecting cross-passage evidences, and the answer memory working as a buffer continually refining the generated answers. Empirically, we show the efficacy of the proposed architecture in the multi-passage generative QA, outperforming the state-of-the-art baselines with better syntactically well-formed answers and increased precision in addressing the questions of the AmazonQA review dataset. An additional qualitative analysis revealed the interpretability introduced by the memory module.


title: Social networks, confirmation bias and shock elections

abstract: In recent years online social networks have become increasingly prominent in political campaigns and, concurrently, several countries have experienced shock election outcomes. This paper proposes a model that links these two phenomena. In our set-up, the process of learning from others on a network is influenced by confirmation bias, i.e. the tendency to ignore contrary evidence and interpret it as consistent with one's own belief. When agents pay enough attention to themselves, confirmation bias leads to slower learning in any symmetric network, and it increases polarization in society. We identify a subset of agents that become more/less influential with confirmation bias. The socially optimal network structure depends critically on the information available to the social planner. When she cannot observe agents' beliefs, the optimal network is symmetric, vertex-transitive and has no self-loops. We explore the implications of these results for electoral outcomes and media markets. Confirmation bias increases the likelihood of shock elections, and it pushes fringe media to take a more extreme ideology.


title: Neural Network Design: Learning from Neural Architecture Search

abstract: Neural Architecture Search (NAS) aims to optimize deep neural networks' architecture for better accuracy or smaller computational cost and has recently gained more research interests. Despite various successful approaches proposed to solve the NAS task, the landscape of it, along with its properties, are rarely investigated. In this paper, we argue for the necessity of studying the landscape property thereof and propose to use the so-called Exploratory Landscape Analysis (ELA) techniques for this goal. Taking a broad set of designs of the deep convolutional network, we conduct extensive experimentation to obtain their performance. Based on our analysis of the experimental results, we observed high similarities between well-performing architecture designs, which is then used to significantly narrow the search space to improve the efficiency of any NAS algorithm. Moreover, we extract the ELA features over the NAS landscapes on three common image classification data sets, MNIST, Fashion, and CIFAR-10, which shows that the NAS landscape can be distinguished for those three data sets. Also, when comparing to the ELA features of the well-known Black-Box Optimization Benchmarking (BBOB) problem set, we found out that the NAS landscapes surprisingly form a new problem class on its own, which can be separated from all $24$ BBOB problems. Given this interesting observation, we, therefore, state the importance of further investigation on selecting an efficient optimizer for the NAS landscape as well as the necessity of augmenting the current benchmark problem set.


title: Correcting the algorithm for the secure domination number of cographs by Jha, Pradhan, and Banerjee

abstract: Jha, Pradhan, and Banerjee devised a linear algorithm to compute the secure domination number of a cograph. Here it is shown that their Lemma~2, which is crucial for the computational complexity of the algorithm, is incomplete. An accordingly modified lemma is proved and it is demonstrated that the complexity of the modified algorithm remains linear.


title: Bruce -- Design and Development of a Dynamic Hexapod Robot

abstract: This paper introduces Bruce, the CSIRO Dynamic Hexapod Robot capable of autonomous, dynamic locomotion over difficult terrain. This robot is built around Apptronik linear series elastic actuators, and went from design to deployment in under a year by using approximately 80\% 3D printed structural (joints and link) parts. The robot has so far demonstrated rough terrain traversal over grass, rocks and rubble at 0.3m/s, and flat-ground speeds up to 0.5m/s. This was achieved with a simple controller, inspired by RHex, with a central pattern generator, task-frame impedance control for individual legs and no foot contact detection. The robot is designed to move at up to 1.0m/s on flat ground with appropriate control, and was deployed into the the DARPA SubT Challenge Tunnel circuit event in August 2019.


title: Towards Personalized Explanation of Robot Path Planning via User Feedback

abstract: Prior studies have found that explaining robot decisions and actions helps to increase system transparency, improve user understanding, and enable effective human-robot collaboration. In this paper, we present a system for generating personalized explanations of robot path planning via user feedback. We consider a robot navigating in an environment modeled as a Markov decision process (MDP), and develop an algorithm to automatically generate a personalized explanation of an optimal MDP policy, based on the user preference regarding four elements (i.e., objective, locality, specificity, and corpus). In addition, we design the system to interact with users via answering users' further questions about the generated explanations. Users have the option to update their preferences to view different explanations. The system is capable of detecting and resolving any preference conflict via user interaction. The results of an online user study show that the generated personalized explanations improve user satisfaction, while the majority of users liked the system's capabilities of question-answering and conflict detection/resolution.


title: The Atiyah-Patodi-Singer rho invariant and signatures of links

abstract: Relations between the Atiyah-Patodi-Singer rho invariant and signatures of links have been known for a long time, but they were only partially investigated. In order to explore them further, we develop a versatile cut-and-paste formula for the rho invariant, which allows us to manipulate manifolds in a convenient way. With the help of this tool, we give a description of the multivariable signature of a link $L$ as the rho invariant of some closed $3$-manifold $Y_L$ intrinsically associated to $L$. We study then the rho invariant of the manifolds obtained by Dehn surgery on a $L$ along integer and rational framings. Inspired by related results of Casson and Gordon and Cimasoni and Florens, we give formulas expressing this value as a sum of the multivariable signature of $L$ and some easy-to-compute extra terms.


title: Learning Euler's Elastica Model for Medical Image Segmentation

abstract: Image segmentation is a fundamental topic in image processing and has been studied for many decades. Deep learning-based supervised segmentation models have achieved state-of-the-art performance but most of them are limited by using pixel-wise loss functions for training without geometrical constraints. Inspired by Euler's Elastica model and recent active contour models introduced into the field of deep learning, we propose a novel active contour with elastica (ACE) loss function incorporating Elastica (curvature and length) and region information as geometrically-natural constraints for the image segmentation tasks. We introduce the mean curvature i.e. the average of all principal curvatures, as a more effective image prior to representing curvature in our ACE loss function. Furthermore, based on the definition of the mean curvature, we propose a fast solution to approximate the ACE loss in three-dimensional (3D) by using Laplace operators for 3D image segmentation. We evaluate our ACE loss function on four 2D and 3D natural and biomedical image datasets. Our results show that the proposed loss function outperforms other mainstream loss functions on different segmentation networks. Our source code is available at https://github.com/HiLab-git/ACELoss.


title: A Dilated Residual Hierarchically Fashioned Segmentation Framework for Extracting Gleason Tissues and Grading Prostate Cancer from Whole Slide Images

abstract: Prostate cancer (PCa) is the second deadliest form of cancer in males, and it can be clinically graded by examining the structural representations of Gleason tissues. This paper proposes \RV{a new method} for segmenting the Gleason tissues \RV{(patch-wise) in order to grade PCa from the whole slide images (WSI).} Also, the proposed approach encompasses two main contributions: 1) A synergy of hybrid dilation factors and hierarchical decomposition of latent space representation for effective Gleason tissues extraction, and 2) A three-tiered loss function which can penalize different semantic segmentation models for accurately extracting the highly correlated patterns. In addition to this, the proposed framework has been extensively evaluated on a large-scale PCa dataset containing 10,516 whole slide scans (with around 71.7M patches), where it outperforms state-of-the-art schemes by 3.22% (in terms of mean intersection-over-union) for extracting the Gleason tissues and 6.91% (in terms of F1 score) for grading the progression of PCa.


title: A bound for $1$-cross intersecting set pair systems

abstract: A well-known result of Bollob\'as says that if $\{(A_i, B_i)\}_{i=1}^m$ is a set pair system such that $|A_i| \le a$ and $|B_i| \le b$ for $1 \le i \le m$, and $A_i \cap B_j \ne \emptyset$ if and only if $i \ne j$, then $m \le {a+b \choose a}$. F\"uredi, Gy\'arf\'as and Kir\'aly recently initiated the study of such systems with the additional property that $|A_i \cap B_j| = 1$ for all $i \ne j$. Confirming a conjecture of theirs, we show that this extra condition allows an improvement of the upper bound (at least) by a constant factor.


title: Computational investigation on non-linear optical properties of hexaphyrin and core modified hexaphyrins

abstract: Expanded porphyrin-based (Hexaphyrins) sensitizers are promising due to their excellent light harvesting feature in dye-sensitized solar cell (DSSC). We calculated the low-lying excitations of expanded porphyrins (EPs) as hexaphyrin and core modified hexaphyrin structures using Time-Dependent Density Functional Theory. Our calculation showed the EPs (both hexaphyrin and core modified hexaphyrin) have broad range of absorption band suitable for harvesting the visible and near infrared region of solar spectrum. All EPs studied here satisfy the energy condition of singlet fission (SF). SF is the process in which the theoretical limit of Shockley-Quiesser (SQ) (33\%) can be overcome in single junction solar cell. The non-linear optical properties like first hyper polarizability $\beta$ and second order hyper polarizability $\gamma$ were calculated using coupled perturbed Hartree-Fock approach. From the second order NLO properties we carried out degenerate four wave mixing (DFWM) component ($\gamma^{(2)}(-\omega;\omega,\omega,-\omega$)) and finally quadratic non linear refractive indices of these EPs are calculated. Calculation showed EPs are promising as organic dye for the opto-electronic applications and useful for high efficiency DSSC and also useful for potential NLO materials as their hyper polarizabilities showed higher order non linearities.


title: Revised QCD effects on the Z $\to b\bar{b}$ forward-backward asymmetry

abstract: The forward-backward (FB) asymmetry of $b$ quarks in $e^+e^-$ collisions at the Z pole measured at LEP, $A_{FB}^{0,b} = 0.0992\pm0.0016$, remains today the electroweak precision observable with the largest disagreement (2.4$\sigma$) with respect to the Standard Model prediction, $(A_{FB}^{0,b})_{_{\rm th}} = 0.1030 \pm 0.0002$. Beyond the dominant statistical uncertainties, QCD effects, such as $b$-quark showering and hadronization, are the leading sources of $A_{FB}^{0,b}$ systematic uncertainty, and have not been revised in the last twenty years. We reassess the QCD uncertainties of the eight original $A_{FB}^{0,b}$ LEP measurements, using modern parton shower PYTHIA-8 and PYTHIA-8 + VINCIA simulations with nine different implementations of soft and collinear radiation as well as of parton fragmentation. Our analysis, combined with NNLO massive $b$-quark corrections independently computed recently, indicates total propagated QCD uncertainties of $\sim$0.7% and $\sim$0.3% for the lepton-charge and jet-charge analyses, respectively, that are about a factor of two smaller than those of the original LEP results. Accounting for such updated QCD effects leads to a new $A_{FB}^{0,b} = 0.0996\pm0.0016$ average, with a data-theory tension slightly reduced from 2.4$\sigma$ to 2.1$\sigma$. Confirmation or resolution of this long-term discrepancy requires a new high-luminosity $e^+e^-$ collider collecting orders-of-magnitude more data at the Z pole to significantly reduce the $A_{FB}^{0,b}$ statistical uncertainties.


title: Transfer of large-scale perovskite single-crystalline thin films onto arbitrary substrates

abstract: Metal halide perovskites single-crystalline thin films (SCTFs) have recently emerged as promising materials for the next generation of optoelectronic devices due to their superior intrinsic properties. However, it is still challenging to transfer and integrate them with other functional materials for hybrid multilayer devices because of their substrate-dependent growth. Herein, a method that allows the SCTFs to be transferred with high quality onto arbitrary substrates has been reported. By introducing hydrophobic treatment to the growth substrates, the adhesion between SCTFs and growth substrates is reduced. Meanwhile, anti-solvent intercalation technique is used to peel off SCTFs from the growth substrates intactly. Finally, centimeter-scale perovskite SCTF has been successfully transferred to target substrate. This work opens up a new route to transfer large-scale perovskite SCTFs, providing a platform to widen the applications of perovskite SCTFs in large-scale hybrid multilayer optoelectronic devices.


title: Designing intramolecular singlet-fission materials using indeno[1,2-b]fluorene dimers: A DMRG and TDDFT study

abstract: Low-lying excited states for indeno[1,2-b]fluorene homo dimers with or without benzene spacers are calculated using the Density Matrix Renormalization group (DMRG) approach within Pariser-Parr-Pople (PPP) model Hamiltonian. DMRG calculations suggest that all the dimers studied here satisfy the essential energy conditions for SF. SF is a multiexciton generation process. As it is spin allowed, the process is very fast. By generating multiple exciton at a time SF underestimate SQ limit to enhance photo-conversion efficiency of single junction solar cells. Frontier orbital calculation through Density Functional Theory (DFT) depicts orbital localization of triplets on either side of the covalent spacers. Which supports the entangled triplet-triplet state $^1(TT)$. Here the process is intramolecular (iSF), which has many advantages over the intermolecular (xSF) process, as in intermolecular process the SF process is highly dependent on the crystal packing, defects, dislocations etc. The entangled $^1(TT)$ state for xSF is localized on both of the chromophores, thus the appropriate crystal packing is essential for xSF. However iSF does not depend on the crystal packing. Our DMRG calculation and TDDFT calculation are in well agreement with experimental results found in the literature. Thus indeno[1,2-b]fluorene homo dimers can be applicable in iSF application.


title: Bipolar Magnetic Semiconducting Behavior in VNbRuAl: A New Spintronic Material for Spin Filters

abstract: We report the theoretical prediction of a new class of spintronic materials, namely bipolar magnetic semiconductor (BMS), which is also supported by our experimental data. BMS acquires a unique band structure with unequal band gaps for spin up and down channels, and thus are useful for tunable spin transport based applications such as spin filters. The valence band (VB) and conduction band (CB) in BMS approach the Fermi level through opposite spin channels, and hence facilitate to achieve reversible spin polarization which are controllable via applied gate voltage. We report the quaternary Heusler alloy VNbRuAl to exactly possess the band structure of BMS. The alloy is found to crystallize in LiMgPdSn prototype structure (space group $F\bar{4}3m$) with B$2$ disorder and lattice parameter 6.15 \AA . The resistivity and Hall measurements show a two channel semiconducting behavior and a quasi linear dependence of negative magneto resistance (MR) indicating the possible semiconducting nature. Interestingly, VNbRuAl also shows a fully compensated ferrimagnetic (FCF) behavior with vanishing net magnetization (m$_s$$\sim$ $10^{-3}$ $\mu_B/f.u.$) and significantly high ordering temperature ($> 900$ K). Unlike conventional FCF, vanishing moment in this case appears to be the result of a combination of long range antiferromagnetic (AFM) ordering and the inherent B2 disorder of the crystal. This study opens up the possibility of finding a class of materials for AFM spintronics, with great significance both from fundamental and applied fronts.


title: Neuromorphic control for optic-flow-based landings of MAVs using the Loihi processor

abstract: Neuromorphic processors like Loihi offer a promising alternative to conventional computing modules for endowing constrained systems like micro air vehicles (MAVs) with robust, efficient and autonomous skills such as take-off and landing, obstacle avoidance, and pursuit. However, a major challenge for using such processors on robotic platforms is the reality gap between simulation and the real world. In this study, we present for the very first time a fully embedded application of the Loihi neuromorphic chip prototype in a flying robot. A spiking neural network (SNN) was evolved to compute the thrust command based on the divergence of the ventral optic flow field to perform autonomous landing. Evolution was performed in a Python-based simulator using the PySNN library. The resulting network architecture consists of only 35 neurons distributed among 3 layers. Quantitative analysis between simulation and Loihi reveals a root-mean-square error of the thrust setpoint as low as 0.005 g, along with a 99.8% matching of the spike sequences in the hidden layer, and 99.7% in the output layer. The proposed approach successfully bridges the reality gap, offering important insights for future neuromorphic applications in robotics. Supplementary material is available at https://mavlab.tudelft.nl/loihi/.


title: Reanalysis of the top-quark pair hadroproduction and a precise determination of the top-quark pole mass at the LHC

abstract: In this paper, we calculate the $t\bar{t}$ pQCD production cross-section at NNLO and determine the top-quark pole mass from recent measurements at the LHC at $\sqrt{S}=13$ TeV center-of-mass energy to high precision by applying the Principle of Maximum Conformality (PMC). The PMC provides a systematic method which rigorously eliminates QCD renormalization scale ambiguities by summing the nonconformal $\beta$ contributions into the QCD coupling constant. The PMC predictions satisfy the requirements of renormalization group invariance, including renormalization scheme independence, and the PMC scales accurately reflect the virtuality of the underlying production subprocesses. By using the PMC, an improved prediction for the $t\bar{t}$ production cross-section is obtained without scale ambiguities, which in turn provides a precise value for the top-quark pole mass. Moreover, the predictive power of PMC calculations that the magnitude of higher-order PMC predictions are well within the error bars predicted from the known lower-order has been demonstrated for the top-quark pair production. The resulting determination of the top-quark pole mass $m_t^{\rm pole}=172.5\pm1.4$ GeV from the LHC measurement at $\sqrt{S}=13$ TeV is in agreement with the current world average cited by the Particle Data Group (PDG). The PMC prediction provides an important high-precision test of the consistency of pQCD and the SM at $\sqrt{S}=13$ TeV with previous LHC measurements at lower CM energies.


title: Confinement within the use of Minkowski space integral representation

abstract: We determine the gluonic spectral function $SU(3)$ Yang-Mills theory as well as we found fermionic spectral functions in the strong quenched QED where we found new solutions. Our novel technique provides solutions with the usual branch cut for propagators while not showing any pole structure at the first Riemann sheet (identical with entire complex plane) of complex square of momentum. Implications and further utilizations are briefly adressed for QCD and Standard model calculations.


title: Quantitative particle approximation of nonlinear Fokker-Planck equations with singular kernel

abstract: In this work, we study the convergence of the empirical measure of moderately interacting particle systems with singular interaction kernels. First, we prove quantitative convergence of the time marginals of the empirical measure of particle positions towards the solution of the limiting nonlinear Fokker-Planck equation. Second, we prove the well-posedness for the McKean-Vlasov SDE involving such singular kernels and the convergence of the empirical measure towards it (propagation of chaos). Our results only require very weak regularity on the interaction kernel, including the Biot-Savart kernel, and attractive kernels such as Riesz and Keller-Segel kernels in arbitrary dimension. For some of these important examples, this is the first time that a quantitative approximation of the PDE is obtained by means of a stochastic particle system. In particular, this convergence still holds (locally in time) for PDEs exhibiting a blow-up in finite time. The proofs are based on a semigroup approach combined with a fine analysis of the regularity of infinite-dimensional stochastic convolution integrals.


title: Deep Diacritization: Efficient Hierarchical Recurrence for Improved Arabic Diacritization

abstract: We propose a novel architecture for labelling character sequences that achieves state-of-the-art results on the Tashkeela Arabic diacritization benchmark. The core is a two-level recurrence hierarchy that operates on the word and character levels separately---enabling faster training and inference than comparable traditional models. A cross-level attention module further connects the two, and opens the door for network interpretability. The task module is a softmax classifier that enumerates valid combinations of diacritics. This architecture can be extended with a recurrent decoder that optionally accepts priors from partially diacritized text, which improves results. We employ extra tricks such as sentence dropout and majority voting to further boost the final result. Our best model achieves a WER of 5.34%, outperforming the previous state-of-the-art with a 30.56% relative error reduction.


title: Different anomalous diffusion regimes measured in the dynamics of tracer particles in actin networks

abstract: It was previously believed that diffusion of a tracer particle in a viscoelastic material should be of the fractional Brownian motion (fBm) type. This is due to the long-term memory in the response of such materials to mechanical perturbations. Surprisingly, the diffusion of a tracer particle in a network of a purified protein, actin, was found to conform to the continuous time random walk (CTRW) type in one study that focused on the ensemble average characteristics. Here, we analyze the dynamics of two differently sized tracer particles in actin networks of different mesh sizes. We find that the ratio of tracer particle size to the characteristic length scale of a bio-polymer network plays a crucial role in determining the type of diffusion the particle performs. We find that the tracer particle diffusion has features of fBm when the particle is large compared to the mesh size, of normal diffusion when the particle is much smaller than the mesh size, and of CTRW in between these two limits. Based on our findings, we propose and verify numerically a new model for the tracer particle's motion in all regimes. Our model suggests that diffusion in actin networks consists of fBm of the tracer particle coupled with occasional caging events with power-law-distributed escape times.


title: Unsupervised Intrusion Detection System for Unmanned Aerial Vehicle with Less Labeling Effort

abstract: Along with the importance of safety, an IDS has become a significant task in the real world. Prior studies proposed various intrusion detection models for the UAV. Past rule-based approaches provided a concrete baseline IDS model, and the machine learning-based method achieved a precise intrusion detection performance on the UAV with supervised learning models. However, previous methods have room for improvement to be implemented in the real world. Prior methods required a large labeling effort on the dataset, and the model could not identify attacks that were not trained before. To jump over these hurdles, we propose an IDS with unsupervised learning. As unsupervised learning does not require labeling, our model let the practitioner not to label every type of attack from the flight data. Moreover, the model can identify an abnormal status of the UAV regardless of the type of attack. We trained an autoencoder with the benign flight data only and checked the model provides a different reconstruction loss at the benign flight and the flight under attack. We discovered that the model produces much higher reconstruction loss with the flight under attack than the benign flight; thus, this reconstruction loss can be utilized to recognize an intrusion to the UAV. With consideration of the computation overhead and the detection performance in the wild, we expect our model can be a concrete and practical baseline IDS on the UAV.


title: Neutron scattering investigation of proposed Kosterlitz-Thouless transitions in the triangular-lattice Ising antiferromagnet TmMgGaO4

abstract: The transverse-field Ising model on the triangular lattice is expected to host an intermediate finite-temperature Kosterlitz-Thouless (KT) phase through a mapping of the spins on each triangular unit to a complex order parameter. TmMgGaO$_4$ is a candidate material to realize such physics due to the non-Kramers nature of Tm$^{3+}$ ion and the resulting two-singlet single-ion ground state. Using inelastic neutron scattering, we confirm this picture by determining the leading parameters of the low-energy effective Hamiltonian of TmMgGaO$_4$. Subsequently, we track the predicted KT phase and related transitions by inspecting the field and temperature dependence of the ac susceptibility. We further probe the spin correlations in both reciprocal space and real space via single crystal neutron diffraction and magnetic total scattering techniques, respectively. Magnetic pair distribution function analysis provides evidence for the formation of vortex-antivortex pairs that characterize the proposed KT phase around 5~K. Although structural disorder influences the field-induced behavior of TmMgGaO$_4$, the magnetism in zero field appears relatively free from these effects. These results position TmMgGaO$_4$ as a strong candidate for a solid-state realization of KT physics in a dense spin system.


title: Robust Sequence Submodular Maximization

abstract: Submodularity is an important property of set functions and has been extensively studied in the literature. It models set functions that exhibit a diminishing returns property, where the marginal value of adding an element to a set decreases as the set expands. This notion has been generalized to considering sequence functions, where the order of adding elements plays a crucial role and determines the function value; the generalized notion is called sequence (or string) submodularity. In this paper, we study a new problem of robust sequence submodular maximization with cardinality constraints. The robustness is against the removal of a subset of elements in the selected sequence (e.g., due to malfunctions or adversarial attacks). Compared to robust submodular maximization for set function, new challenges arise when sequence functions are concerned. Specifically, there are multiple definitions of submodularity for sequence functions, which exhibit subtle yet critical differences. Another challenge comes from two directions of monotonicity: forward monotonicity and backward monotonicity, both of which are important to proving performance guarantees. To address these unique challenges, we design two robust greedy algorithms: while one algorithm achieves a constant approximation ratio but is robust only against the removal of a subset of contiguous elements, the other is robust against the removal of an arbitrary subset of the selected elements but requires a stronger assumption and achieves an approximation ratio that depends on the number of the removed elements. Finally, we generalize the analyses to considering sequence functions under weaker assumptions based on approximate versions of sequence submodularity and backward monotonicity


title: Semantic coordinates analysis reveals language changes in the AI field

abstract: Semantic shifts can reflect changes in beliefs across hundreds of years, but it is less clear whether trends in fast-changing communities across a short time can be detected. We propose semantic coordinates analysis, a method based on semantic shifts, that reveals changes in language within publications of a field (we use AI as example) across a short time span. We use GloVe-style probability ratios to quantify the shifting directions and extents from multiple viewpoints. We show that semantic coordinates analysis can detect shifts echoing changes of research interests (e.g., "deep" shifted further from "rigorous" to "neural"), and developments of research activities (e,g., "collaboration" contains less "competition" than "collaboration"), based on publications spanning as short as 10 years.


title: Comments on "correspondence analysis makes you blind"

abstract: Collins' (2002) statement "correspondence analysis makes you blind" followed after his seriation like description of a brand attribute count data set analyzed by Whitlark and Smith (2001), who applied correspondence analysis. In this essay we comment on Collins' statement within taxicab correspondence analysis framework by simultaneously decomposing the covariance matrix and its associated density matrix, thus interpreting two interrelated maps for contingency tables : TCov map and TCA map.


title: On stability for semilinear generalized Rayleigh-Stokes equation involving delays

abstract: We consider a functional semilinear Rayleigh-Stokes equation involving fractional derivative. Our aim is to analyze some circumstances, in those the global solvability and some results on asymptotic behavior of solutions take place. By establishing a new Halanay type inequality, we show the dissipativity and asymptotic stability of solutions to our problem. In addition, we prove the existence of a compact set of decay solutions by using local estimates and fixed point arguments.


title: Using Multivariate Generalised Linear Mixed Models for Studying Roots Development: An Example Based on Minirhizotron Observations

abstract: The characterisation of the spatial and temporal distribution of the root system in a cultivated field depends on the soil volume occupied by the root systems (the scatter), and the local intensity of the root colonisation in the field (the intensity). We introduce a multivariate generalised linear mixed model for simultaneously describing the scatter and the intensity using data obtained with minirhizotrons (i.e., tubes with observation windows, which are inserted in the soil, enabling to observe the roots directly). The models presented allow studying intricate spatial and temporal dependence patterns using a graphical model to represent the dependence structure of latent random components. The scatter is described by a binomial mixed model (presence of roots in observation windows). The number of roots crossing the reference lines in the observational windows of the minirhizotron is used to estimate the intensity through a specially defined Poisson mixed model. We explore the fact that it is possible to construct multivariate extensions of generalised linear mixed models that allow to simultaneously represent patterns of dependency of the scatter and the intensity along with time and space. We present an example where the intensity and scatter are simultaneously determined at three different time points. A positive association between the intensity and scatter at each time point was found, suggesting that the plants are not compensating a reduced occupation of the soil by increasing the number of roots per volume of soil. Using the general properties of graphical models, we identify a first-order Markovian dependence pattern between successively observed scatters and intensities. This lack of memory indicates that no long-lasting temporal causal effects are affecting the roots' development. The two dependence patterns described above cannot be detected with univariate models.


title: SMRT Chatbots: Improving Non-Task-Oriented Dialog with Simulated Multiple Reference Training

abstract: Non-task-oriented dialog models suffer from poor quality and non-diverse responses. To overcome limited conversational data, we apply Simulated Multiple Reference Training (SMRT; Khayrallah et al., 2020), and use a paraphraser to simulate multiple responses per training prompt. We find SMRT improves over a strong Transformer baseline as measured by human and automatic quality scores and lexical diversity. We also find SMRT is comparable to pretraining in human evaluation quality, and outperforms pretraining on automatic quality and lexical diversity, without requiring related-domain dialog data.


title: Deformations of Singular Minimal Hypersurfaces I, Isolated Singularities

abstract: Locally stable minimal hypersurface could have singularities in dimension $\geq 7$ in general, locally modeled on stable and area-minimizing cones in the Euclidean spaces. In this paper, we present different aspects of how these singularities may affect the local behavior of minimal hypersurfaces. First, given a non-degenerate minimal hypersurface with strictly stable and strictly minimizing tangent cone at each singular point, under any small perturbation of the metric, we show the existence of a nearby minimal hypersurface under new metric. For a generic choice of perturbation direction, we show the entire smoothness of the resulting minimal hypersurface. Second, given a strictly stable minimal hypersurface $\Sigma$ with strictly minimizing tangent cone at each singular point, we show that $\Sigma$ is uniquely homologically minimizing in its neighborhood. Lastly, given a family of stable minimal hypersurfaces multiplicity $1$ converges to a stable minimal hypersurface $\Sigma$ in an eight manifold, we show that there exists a non-trivial Jacobi field on $\Sigma$ induced by these converging hypersurfaces, which generalizes a result by Ben Sharp in smooth case; Moreover, positivity of this Jacobi field implies smoothness of the converging sequence.


title: Modelling the Galactic Foreground and Beam Chromaticity for Global 21-cm Cosmology

abstract: In order to characterize and model the beam-weighted foreground for global 21-cm signal experiments, we present a methodology for generating basis eigenvectors that combines analytical and observational models of both the galactic spectral index and sky brightness temperature with simulations of beams having various angular and spectral dependencies and pointings. Each combination creates a unique beam-weighted foreground. By generating eigenvectors to fit each foreground model using Singular Value Decomposition (SVD), we examine the effects of varying the components of the beam-weighted foreground. We find that the eigenvectors for modelling an achromatic, isotropic beam -- the ideal case -- are nearly identical regardless of the unweighted foreground model used, and are practicably indistinguishable from polynomial-based models. When anisotropic, chromatic beams weight the foreground, however, a coupling is introduced between the spatial and spectral structure of the foreground which distorts the eigenvectors away from the polynomial models and induces a dependence of the basis upon the exact features of the beam (chromaticity, pattern, pointing) and foreground (spectral index, sky brightness temperature map). We find that the beam has a greater impact upon the eigenvectors than foreground models. Any model which does not account for its distortion may produce RMS uncertainties on the order of $\sim 10$ - $10^3$ Kelvin for six-parameter, single spectrum fits. If the beam is incorporated directly using SVD and training sets, however, the resultant eigenvectors yield milli-Kelvin level uncertainties. Given a sufficiently detailed description of the sky, our methodology can be applied to any particular experiment with a suitably characterized beam for the purpose of generating accurate beam-weighted foreground models.


title: U-rank: Utility-oriented Learning to Rank with Implicit Feedback

abstract: Learning to rank with implicit feedback is one of the most important tasks in many real-world information systems where the objective is some specific utility, e.g., clicks and revenue. However, we point out that existing methods based on probabilistic ranking principle do not necessarily achieve the highest utility. To this end, we propose a novel ranking framework called U-rank that directly optimizes the expected utility of the ranking list. With a position-aware deep click-through rate prediction model, we address the attention bias considering both query-level and item-level features. Due to the item-specific attention bias modeling, the optimization for expected utility corresponds to a maximum weight matching on the item-position bipartite graph. We base the optimization of this objective in an efficient Lambdaloss framework, which is supported by both theoretical and empirical analysis. We conduct extensive experiments for both web search and recommender systems over three benchmark datasets and two proprietary datasets, where the performance gain of U-rank over state-of-the-arts is demonstrated. Moreover, our proposed U-rank has been deployed on a large-scale commercial recommender and a large improvement over the production baseline has been observed in an online A/B testing.


title: Adversarial Self-Supervised Scene Flow Estimation

abstract: This work proposes a metric learning approach for self-supervised scene flow estimation. Scene flow estimation is the task of estimating 3D flow vectors for consecutive 3D point clouds. Such flow vectors are fruitful, \eg for recognizing actions, or avoiding collisions. Training a neural network via supervised learning for scene flow is impractical, as this requires manual annotations for each 3D point at each new timestamp for each scene. To that end, we seek for a self-supervised approach, where a network learns a latent metric to distinguish between points translated by flow estimations and the target point cloud. Our adversarial metric learning includes a multi-scale triplet loss on sequences of two-point clouds as well as a cycle consistency loss. Furthermore, we outline a benchmark for self-supervised scene flow estimation: the Scene Flow Sandbox. The benchmark consists of five datasets designed to study individual aspects of flow estimation in progressive order of complexity, from a moving object to real-world scenes. Experimental evaluation on the benchmark shows that our approach obtains state-of-the-art self-supervised scene flow results, outperforming recent neighbor-based approaches. We use our proposed benchmark to expose shortcomings and draw insights on various training setups. We find that our setup captures motion coherence and preserves local geometries. Dealing with occlusions, on the other hand, is still an open challenge.


title: Mixed--frequency quantile regressions to forecast Value--at--Risk and Expected Shortfall

abstract: Although quantile regression to calculate risk measures has been widely established in the financial literature, when considering data observed at mixed--frequency, an extension is needed. In this paper, a model is suggested built on a mixed--frequency quantile regression to directly estimate the Value--at--Risk (VaR) and the Expected Shortfall (ES) measures. In particular, the low--frequency component incorporates information coming from variables observed at, typically, monthly or lower frequencies, while the high--frequency component can include a variety of daily variables, like market indices or realized volatility measures. The conditions for the weak stationarity of the daily return process are derived and the finite sample properties are investigated in an extensive Monte Carlo exercise. The validity of the proposed model is then explored through a real data application using two energy commodities, namely, Crude Oil and Gasoline futures. Results show that our model outperforms other competing specifications, on the basis of some popular VaR and ES backtesting test procedures.


title: Memory Group Sampling Based Online Action Recognition Using Kinetic Skeleton Features

abstract: Online action recognition is an important task for human centered intelligent services, which is still difficult to achieve due to the varieties and uncertainties of spatial and temporal scales of human actions. In this paper, we propose two core ideas to handle the online action recognition problem. First, we combine the spatial and temporal skeleton features to depict the actions, which include not only the geometrical features, but also multi-scale motion features, such that both the spatial and temporal information of the action are covered. Second, we propose a memory group sampling method to combine the previous action frames and current action frames, which is based on the truth that the neighbouring frames are largely redundant, and the sampling mechanism ensures that the long-term contextual information is also considered. Finally, an improved 1D CNN network is employed for training and testing using the features from sampled frames. The comparison results to the state of the art methods using the public datasets show that the proposed method is fast and efficient, and has competitive performance


title: Can a Robot Trust You? A DRL-Based Approach to Trust-Driven Human-Guided Navigation

abstract: Humans are known to construct cognitive maps of their everyday surroundings using a variety of perceptual inputs. As such, when a human is asked for directions to a particular location, their wayfinding capability in converting this cognitive map into directional instructions is challenged. Owing to spatial anxiety, the language used in the spoken instructions can be vague and often unclear. To account for this unreliability in navigational guidance, we propose a novel Deep Reinforcement Learning (DRL) based trust-driven robot navigation algorithm that learns humans' trustworthiness to perform a language guided navigation task. Our approach seeks to answer the question as to whether a robot can trust a human's navigational guidance or not. To this end, we look at training a policy that learns to navigate towards a goal location using only trustworthy human guidance, driven by its own robot trust metric. We look at quantifying various affective features from language-based instructions and incorporate them into our policy's observation space in the form of a human trust metric. We utilize both these trust metrics into an optimal cognitive reasoning scheme that decides when and when not to trust the given guidance. Our results show that the learned policy can navigate the environment in an optimal, time-efficient manner as opposed to an explorative approach that performs the same task. We showcase the efficacy of our results both in simulation and a real-world environment.


title: Intertwined Topological and Magnetic Orders in Atomically Thin Chern Insulator MnBi2Te4

abstract: The interplay between band topology and magnetic order plays a key role in quantum states of matter. MnBi2Te4, a van der Waals magnet, has recently emerged as an exciting platform for exploring Chern insulator physics. Its layered antiferromagnetic order was predicted to enable even-odd layer-number dependent topological states, supported by promising edge transport measurements. Furthermore, it becomes a Chern insulator when all spins are aligned by an applied magnetic field. However, the evolution of the bulk electronic structure as the magnetic state is continuously tuned and its dependence on layer number remains unexplored. Here, employing multimodal probes, we establish one-to-one correspondence between bulk electronic structure, magnetic state, topological order, and layer thickness in atomically thin MnBi2Te4 devices. As the magnetic state is tuned through the canted magnetic phase, we observe a band crossing, i.e., the closing and reopening of the bulk bandgap, corresponding to the concurrent topological phase transition. Surprisingly, we find that the even- and odd-layer number devices exhibit a similar topological phase transition coupled to magnetic states, distinct from recent theoretical and experimental reports. Our findings shed new light on the interplay between band topology and magnetic order in this newly discovered topological magnet and validate the band crossing with concurrent measurements of topological invariant in a continuously tuned topological phase transition.


title: Institution-based Encoding and Verification of Simple UML State Machines in CASL/SPASS

abstract: This paper provides the first correct semantical representation of UML state-machines within the logical framework of an institution (previous attempts were flawed). A novel encoding of this representation into first-order logic enables symbolic analyses through a multitude of theorem-provers. UML state-machines are central to model-based systems-engineering. Till now, state-machine analysis has been mostly restricted to model checking, which for state-machines suffers heavily from the state-space explosion problem. Symbolic reasoning, as enabled and demonstrated here, provides a powerful alternative, which can deal with large or even infinite state spaces. Full proofs are given.


title: A note on the option price and 'Mass at zero in the uncorrelated SABR model and implied volatility asymptotics'

abstract: Gulisashvili et al. [Quant. Finance, 2018, 18(10), 1753-1765] provide a small-time asymptotics for the mass at zero under the uncorrelated stochastic-alpha-beta-rho (SABR) model by approximating the integrated variance with a moment-matched lognormal distribution. We improve the accuracy of the numerical integration by using the Gauss--Hermite quadrature. We further obtain the option price by integrating the constant elasticity of variance (CEV) option prices in the same manner without resorting to the small-strike volatility smile asymptotics of De Marco et al. [SIAM J. Financ. Math., 2017, 8(1), 709-737]. For the uncorrelated SABR model, the new option pricing method is accurate and arbitrage-free across all strike prices.


title: Local Groups in Delone Sets

abstract: In the paper, we prove that in an arbitrary Delone set $X$ in $3D$ space, the subset $X_6$ of all points from $X$ at which local groups have axes of the order not greater than 6 is also a Delone set. Here, under the local group at point $x\in X$ is meant the symmetry group $S_x(2R)$ of the cluster $C_x(2R)$ of $x$ with radius $2R$, where $R$ (according to Delone's theory of the 'empty sphere') is the radius of the largest 'empty' ball, that is, the largest ball free of points of $X$. The main result seems to be the first rigorously proved statement on absolutely generic Delone sets which implies substantial statements for Delone sets with strong crystallographic restrictions. For instance, an important observation of Shtogrin on the boundedness of local groups in Delone sets with equivalent $2R$-clusters immediately follows from the main theorem. In the paper, the 'crystalline kernel conjecture' (Conjecture 1) and its two weaker versions (Conjectures 2 and 3) are suggested. According to Conjecture 1, in a quite arbitrary Delone set, points with locally crystallographic axes (of order 2,3,4, or 6) only inevitably constitute an essential part of the set. These conjectures significantly generalize the famous statement of Crystallography on the impossibility of (global) 5-fold symmetry in a 3D lattice.


title: WLV-RIT at HASOC-Dravidian-CodeMix-FIRE2020: Offensive Language Identification in Code-switched YouTube Comments

abstract: This paper describes the WLV-RIT entry to the Hate Speech and Offensive Content Identification in Indo-European Languages (HASOC) shared task 2020. The HASOC 2020 organizers provided participants with annotated datasets containing social media posts of code-mixed in Dravidian languages (Malayalam-English and Tamil-English). We participated in task 1: Offensive comment identification in Code-mixed Malayalam Youtube comments. In our methodology, we take advantage of available English data by applying cross-lingual contextual word embeddings and transfer learning to make predictions to Malayalam data. We further improve the results using various fine tuning strategies. Our system achieved 0.89 weighted average F1 score for the test set and it ranked 5th place out of 12 participants.


title: A Flow-Efficient and Legal-by-Construction Real-Time Traffic Signal Control Platform

abstract: Inefficiencies in traffic flow through an intersection lead to stopping vehicles, unnecessary congestion, and increased accident risk. In this paper, we propose a traffic signal controller platform demonstrating the ability to increase traffic flow for arbitrary intersection topologies. This model uses Model Predictive Control on a Mixed Logical Dynamical system to control the state of independently controlled traffic signals in a single intersection, removing constraints forcing the selection of signals from a set of phases. Further, we use constraints to impose a guarantee on the output of the system to be in the set of permissible actions under constraints including precise yellow timing, minimum inter-lane green transition timing, and selection of signal states with non-conflicting dependencies. We evaluate our model on a simulated 4-way intersection and an intersection in Denmark with true traffic data and a currently implemented timing schedule as a baseline. Our model shows at least 22\% reduction in time loss compared to baseline light schedules, and timing shows that this system can feasibly run online predictions at a frequency faster than 2s/prediction optimizing over a prediction horizon of 25s.


title: All-nitrogen cages and molecular crystals: Topological rules, stability, and pyrolysis paths

abstract: We have combined ab initio molecular dynamics with the intrinsic reaction coordinate in order to investigate the mechanisms of stability and pyrolysis of N$_{4}$-- N$_{120}$ fullerene-like nitrogen cages. The stability of the cages was evaluated in terms of the activation barriers and the activation Gibbs energies of their thermal-induced breaking. We found that binding energies, bond lengths, and quantum-mechanical descriptors failed to predict the stability of the cages. However, we derived a simple topological rule that adjacent hexagons on the cage surface resulted in its instability. For this reason, the number of stable nitrogen cages is significantly restricted in comparison with their carbon counterparts. As a rule, smaller clusters are more stable, whereas earlier proposed rather large cages collapse at room temperature. The most stable all-nitrogen cages are N$_{4}$ and N$_{6}$ clusters, which can form the van-der-Waals crystals with the densities of 1.23 and 1.36 g/cm$^{3}$, respectively. Examination of their band structures and densities of electronic states shows that they are both insulators. Their power and sensitivity are not inferior to the modern advanced high-energy nanosystems.


title: High magnetic field ultrasound study of spin freezing in La$_{1.88}$Sr$_{0.12}$CuO$_4$

abstract: High-$T_{\rm{c}}$ cuprate superconductors host spin, charge and lattice instabilities. In particular, in the antiferromagnetic glass phase, over a large doping range, lanthanum based cuprates display a glass-like spin freezing with antiferromagnetic correlations. Previously, sound velocity anomalies in La$_{2-x}$Sr$_{x}$CuO$_4$ (LSCO) for hole doping $p\geq 0.145$ were reported and interpreted as arising from a coupling of the lattice to the magnetic glass [Frachet, Vinograd et al., Nat. Phys. 16, 1064-1068 (2020)]. Here we report both sound velocity and attenuation in LSCO $p=0.12$, i.e. at a doping level for which the spin freezing temperature is the highest. Using high magnetic fields and comparing with nuclear magnetic resonance (NMR) measurements, we confirm that the anomalies in the low temperature ultrasound properties of LSCO are produced by a coupling between the lattice and the spin glass. Moreover, we show that both sound velocity and attenuation can be simultaneously accounted for by a simple phenomenological model originally developed for canonical spin glasses. Our results point towards a strong competition between superconductivity and spin freezing, tuned by the magnetic field. A comparison of different acoustic modes suggests that the slow spin fluctuations have a nematic character.


title: Learning Robot Trajectories subject to Kinematic Joint Constraints

abstract: We present an approach to learn fast and dynamic robot motions without exceeding limits on the position $\theta$, velocity $\dot{\theta}$, acceleration $\ddot{\theta}$ and jerk $\dddot{\theta}$ of each robot joint. Movements are generated by mapping the predictions of a neural network to safely executable joint accelerations. The neural network is invoked periodically and trained via reinforcement learning. Our main contribution is an analytical procedure for calculating safe joint accelerations, which considers the prediction frequency $f_N$ of the neural network. As a result, the frequency $f_N$ can be freely chosen and treated as a hyperparameter. We show that our approach is preferable to penalizing constraint violations as it provides explicit guarantees and does not distort the desired optimization target. In addition, the influence of the selected prediction frequency on the learning performance and on the computing effort is highlighted by various experiments.


title: Recent Neural Methods on Slot Filling and Intent Classification for Task-Oriented Dialogue Systems: A Survey

abstract: In recent years, fostered by deep learning technologies and by the high demand for conversational AI, various approaches have been proposed that address the capacity to elicit and understand user's needs in task-oriented dialogue systems. We focus on two core tasks, slot filling (SF) and intent classification (IC), and survey how neural-based models have rapidly evolved to address natural language understanding in dialogue systems. We introduce three neural architectures: independent model, which model SF and IC separately, joint models, which exploit the mutual benefit of the two tasks simultaneously, and transfer learning models, that scale the model to new domains. We discuss the current state of the research in SF and IC and highlight challenges that still require attention.


title: CURE: Collection for Urdu Information Retrieval Evaluation and Ranking

abstract: Urdu is a widely spoken language with 163 million speakers worldwide across the globe. Information Retrieval (IR) for Urdu entails special consideration of research community due to its rich morphological features and a large number of speakers. In general, IR evaluation task is not extensively explored for Urdu. The most important missing element is the availability of a standardized evaluation corpus specific to Urdu. In this research work, we propose and construct a standard test collection of Urdu documents for IR evaluation and named it Collection for Urdu Retrieval Evaluation (CURE). We select 1,096 unique documents against 50 diverse queries from a large collection of 0.5 million crawled documents using two IR models. The purpose of test collection is the evaluation of IR models, ranking algorithms, and different natural language processing techniques. Next, we perform binary relevance judgment on the selected documents. We also built two other language resources for lemmatization and query expansion specific to our test collection. Evaluation of test collection is carried out using four retrieval models as well using the stop-words list, lemmatization, and query expansion. Furthermore, error analysis was performed for each query with different NLP techniques. To the best of our knowledge, this work is the first attempt for preparing a standardized information retrieval evaluation test collection for the Urdu language.


title: LG-GAN: Label Guided Adversarial Network for Flexible Targeted Attack of Point Cloud-based Deep Networks

abstract: Deep neural networks have made tremendous progress in 3D point-cloud recognition. Recent works have shown that these 3D recognition networks are also vulnerable to adversarial samples produced from various attack methods, including optimization-based 3D Carlini-Wagner attack, gradient-based iterative fast gradient method, and skeleton-detach based point-dropping. However, after a careful analysis, these methods are either extremely slow because of the optimization/iterative scheme, or not flexible to support targeted attack of a specific category. To overcome these shortcomings, this paper proposes a novel label guided adversarial network (LG-GAN) for real-time flexible targeted point cloud attack. To the best of our knowledge, this is the first generation based 3D point cloud attack method. By feeding the original point clouds and target attack label into LG-GAN, it can learn how to deform the point clouds to mislead the recognition network into the specific label only with a single forward pass. In detail, LGGAN first leverages one multi-branch adversarial network to extract hierarchical features of the input point clouds, then incorporates the specified label information into multiple intermediate features using the label encoder. Finally, the encoded features will be fed into the coordinate reconstruction decoder to generate the target adversarial sample. By evaluating different point-cloud recognition models (e.g., PointNet, PointNet++ and DGCNN), we demonstrate that the proposed LG-GAN can support flexible targeted attack on the fly while guaranteeing good attack performance and higher efficiency simultaneously.


title: How to build coarse-grain transport models consistent from the kinetic to fluid regimes

abstract: In this paper, we examine how to build coarse-grain transport models consistently from the kinetic to fluid regimes. The internal energy of the gas particles is described through a state-to-state approach. A kinetic equation allows us to study transport phenomena in phase space for a non-homogeneous gas mixture. Internal energy excitation is modeled using a binary collision operator, whereas the gas chemical processes rely on a reactive collision operator. We obtain an asymptotic fluid model by means of a Chapman-Enskog perturbative solution to the Boltzmann equation in the Maxwellian reaction regime. The macroscopic conservation equations of species mass, mixture momentum, and energy are given, as well as expressions of the transport properties. Reversibility relations for elementary processes are formulated in the coarse-grain model at the kinetic level and are enforced in the collision algorithm of the direct simulation Monte Carlo method used to solve the kinetic equation. Furthermore, respecting these reversibility relations is key to deriving a fluid model that is well-posed and compatible with the second law of thermodynamics. Consistency between the kinetic and fluid simulations is assessed for the simulation of a shock wave in a nitrogen gas using the uniform rovibrational collisional coarse-grain model. The kinetic and fluid simulations show consistency for the macroscopic properties and transport fluxes between both regimes.


title: Manifold Learning and Nonlinear Homogenization

abstract: We describe an efficient domain decomposition-based framework for nonlinear multiscale PDE problems. The framework is inspired by manifold learning techniques and exploits the tangent spaces spanned by the nearest neighbors to compress local solution manifolds. Our framework is applied to a semilinear elliptic equation with oscillatory media and a nonlinear radiative transfer equation; in both cases, significant improvements in efficacy are observed. This new method does not rely on detailed analytical understanding of the multiscale PDEs, such as their asymptotic limits, and thus is more versatile for general multiscale problems.


title: DeepOpht: Medical Report Generation for Retinal Images via Deep Models and Visual Explanation

abstract: In this work, we propose an AI-based method that intends to improve the conventional retinal disease treatment procedure and help ophthalmologists increase diagnosis efficiency and accuracy. The proposed method is composed of a deep neural networks-based (DNN-based) module, including a retinal disease identifier and clinical description generator, and a DNN visual explanation module. To train and validate the effectiveness of our DNN-based module, we propose a large-scale retinal disease image dataset. Also, as ground truth, we provide a retinal image dataset manually labeled by ophthalmologists to qualitatively show, the proposed AI-based method is effective. With our experimental results, we show that the proposed method is quantitatively and qualitatively effective. Our method is capable of creating meaningful retinal image descriptions and visual explanations that are clinically relevant.


title: TQ-completion and the Taylor tower of the identity functor

abstract: The goal of this short paper is to study the convergence of the Taylor tower of the identity functor in the context of operadic algebras in spectra. Specifically, we show that if $A$ is a $(-1)$-connected $\mathcal{O}$-algebra with $0$-connected $\mathsf{TQ}$-homology spectrum $\mathsf{TQ}(A)$, then there is a natural weak equivalence $P_\infty$(id)$A\simeq A_\mathsf{TQ}^\wedge$ between the limit of the Taylor tower of the identity functor evaluated on $A$ and the $\mathsf{TQ}$-completion of $A$. Since, in this context, the identity functor is only known to be $0$-analytic, this result extends knowledge of the Taylor tower of the identity beyond its "radius of convergence."


title: Visualisation of Law and Legal Process: An Opportunity Missed

abstract: Visual representation of the law and legal process can aid in recall and discussion of complicated legal concepts, yet is a skill rarely taught in law schools. This work investigates the use of flowcharts and similar process-oriented diagrams in contemporary legal literature through a literature review and concept-based content analysis. Information visualisations (infovis) identified in the literature are classified into eleven described archetypal diagram types, and the results describe their usage quantitatively by type, year, publication venue and legal domain. We found that the use of infovis in legal literature is extremely rare, identifying not more than ten articles in each calendar year. We also identified that the concept flow diagram is most commonly used, and that Unified Modelling Language (UML) is the most frequently applied representational approach. This work posits a number of serious questions for legal educators and practicing lawyers regarding how infovis in legal education and practice may improve access to justice, legal education and lay comprehension of complex legal frameworks and processes. It concludes by asking how we can expect communities to understand and adhere to laws that have become so complex and verbose as to be incomprehensible even to many of those who are learned in the law?


title: Asset Allocation via Machine Learning and Applications to Equity Portfolio Management

abstract: In this paper, we document a novel machine learning based bottom-up approach for static and dynamic portfolio optimization on, potentially, a large number of assets. The methodology applies to general constrained optimization problems and overcomes many major difficulties arising in current optimization schemes. Taking mean-variance optimization as an example, we no longer need to compute the covariance matrix and its inverse, therefore the method is immune from the estimation error on this quantity. Moreover, no explicit calls of optimization routines are needed. Applications to equity portfolio management in U.S. and China equity markets are studied and we document significant excess returns to the selected benchmarks.


title: Two-Level K-FAC Preconditioning for Deep Learning

abstract: In the context of deep learning, many optimization methods use gradient covariance information in order to accelerate the convergence of Stochastic Gradient Descent. In particular, starting with Adagrad, a seemingly endless line of research advocates the use of diagonal approximations of the so-called empirical Fisher matrix in stochastic gradient-based algorithms, with the most prominent one arguably being Adam. However, in recent years, several works cast doubt on the theoretical basis of preconditioning with the empirical Fisher matrix, and it has been shown that more sophisticated approximations of the actual Fisher matrix more closely resemble the theoretically well-motivated Natural Gradient Descent. One particularly successful variant of such methods is the so-called K-FAC optimizer, which uses a Kronecker-factored block-diagonal Fisher approximation as preconditioner. In this work, drawing inspiration from two-level domain decomposition methods used as preconditioners in the field of scientific computing, we extend K-FAC by enriching it with off-diagonal (i.e. global) curvature information in a computationally efficient way. We achieve this by adding a coarse-space correction term to the preconditioner, which captures the global Fisher information matrix at a coarser scale. We present a small set of experimental results suggesting improved convergence behaviour of our proposed method.


title: Human Leg Motion Tracking by Fusing IMUs and RGB Camera Data Using Extended Kalman Filter

abstract: Human motion capture is frequently used to study rehabilitation and clinical problems, as well as to provide realistic animation for the entertainment industry. IMU-based systems, as well as Marker-based motion tracking systems, are the most popular methods to track movement due to their low cost of implementation and lightweight. This paper proposes a quaternion-based Extended Kalman filter approach to recover the human leg segments motions with a set of IMU sensors data fused with camera-marker system data. In this paper, an Extended Kalman Filter approach is developed to fuse the data of two IMUs and one RGB camera for human leg motion tracking. Based on the complementary properties of the inertial sensors and camera-marker system, in the introduced new measurement model, the orientation data of the upper leg and the lower leg is updated through three measurement equations. The positioning of the human body is made possible by the tracked position of the pelvis joint by the camera marker system. A mathematical model has been utilized to estimate joints' depth in 2D images. The efficiency of the proposed algorithm is evaluated by an optical motion tracker system.


title: A Novel Chaotic System for Text Encryption Optimized with Genetic Algorithm

abstract: With meteoric developments in communication systems and data storage technologies, the need for secure data transmission is more crucial than ever. The level of security provided by any cryptosystem relies on the sensitivity of the private key, size of the key space as well as the trapdoor function being used. In order to satisfy the aforementioned constraints, there has been a growing interest over the past few years, in studying the behavior of chaotic systems and their applications in various fields such as data encryption due to characteristics like randomness, unpredictability and sensitivity of the generated sequence to the initial value and its parameters. This paper utilizes a novel 2D chaotic function that displays a uniform bifurcation over a large range of parameters and exhibits high levels of chaotic behavior to generate a random sequence that is used to encrypt the input data. The proposed method uses a genetic algorithm to optimize the parameters of the map to enhance security for any given textual data. Various analyses demonstrate an adequately large key space and the existence of multiple global optima indicating the necessity of the proposed system and the security provided by it.


title: Experimental Design for Regret Minimization in Linear Bandits

abstract: In this paper we propose a novel experimental design-based algorithm to minimize regret in online stochastic linear and combinatorial bandits. While existing literature tends to focus on optimism-based algorithms--which have been shown to be suboptimal in many cases--our approach carefully plans which action to take by balancing the tradeoff between information gain and reward, overcoming the failures of optimism. In addition, we leverage tools from the theory of suprema of empirical processes to obtain regret guarantees that scale with the Gaussian width of the action set, avoiding wasteful union bounds. We provide state-of-the-art finite time regret guarantees and show that our algorithm can be applied in both the bandit and semi-bandit feedback regime. In the combinatorial semi-bandit setting, we show that our algorithm is computationally efficient and relies only on calls to a linear maximization oracle. In addition, we show that with slight modification our algorithm can be used for pure exploration, obtaining state-of-the-art pure exploration guarantees in the semi-bandit setting. Finally, we provide, to the best of our knowledge, the first example where optimism fails in the semi-bandit regime, and show that in this setting our algorithm succeeds.