title: Whole-Body Control with Motion/Force Transmissibility for Parallel-Legged Robot

abstract: For achieving kinematically suitable configurations and highly dynamic task execution, an efficient way is to consider robot performance indices in the whole-body control (WBC) of robots. However, current WBC methods have not considered the intrinsic features of parallel robots, especially motion/force transmissibility (MFT). This paper proposes an MFT-enhanced WBC scheme for parallel-legged robots. Introducing the performance indices of MFT into a WBC is challenging due to the nonlinear relationship between MFT indices and the robot configuration. To overcome this challenge, we establish the MFT preferable space of the robot offline and formulate it as a polyhedron in the joint space at the acceleration level. Then, the WBC employs the polyhedron as a soft constraint. As a result, the robot possesses high-speed and high-acceleration capabilities by satisfying this constraint. The offline preprocessing relieves the online computation burden and helps the WBC achieve a 1kHz servo rate. Finally, we validate the performance and robustness of the proposed method via simulations and experiments on a parallel-legged bipedal robot.


title: Charge density wave breakdown in a heterostructure with electron-phonon coupling

abstract: Understanding the influence of vibrational degrees of freedom on transport through a heterostructure poses considerable theoretical and numerical challenges. In this work, we use the density-matrix renormalization group (DMRG) method together with local basis optimization (LBO) to study the half-filled Holstein model in the presence of a linear potential, either isolated or coupled to tight-binding leads. In both cases, we observe a decay of charge-density-wave (CDW) states at a sufficiently strong potential strength. Local basis optimization selects the most important linear combinations of local oscillator states to span the local phonon space. These states are referred to as optimal modes. We show that many of these local optimal modes are needed to capture the dynamics of the decay, that the most significant optimal mode on the initially occupied sites remains well described by a coherent-state typical for small polarons, and that those on the initially empty sites deviate from the coherent-state form. Additionally, we compute the current through the structure in the metallic regime as a function of voltage. For small voltages, we reproduce results for the Luttinger parameters. As the voltage is increased, the effect of larger electron-phonon coupling strengths becomes prominent. Further, the most significant optimal mode remains almost unchanged when going from the ground state to the current-carrying state in the metallic regime.


title: Impact of Signalized Intersections on $CO_2$ and $NO_x$ Emissions of Heavy Duty Vehicles

abstract: Pollutant emissions have been a topic of interest in the last decades. Not only environmentalists but also governments are taking rapid action to reduce emissions. As one of the main contributors, the transport sector is being subjected to strict scrutiny to ensure it complies with the short and long-term regulations. The measures imposed by the governments clearly involve, all the stakeholders in the logistics sector, from road authorities and logistic operators to truck manufacturers. Improvement of traffic conditions is one of the perspectives in which the reduction of emissions is being addressed. Optimization of traffic flow, avoidance of unnecessary stops, control of the cruise speed, and coordination of trips in an energy-efficient way are necessary steps to remain compliant with the upcoming regulations. In this study, we have measured the $CO_2$ and $NO_x$ emissions in heavy-duty vehicles while traversing signalized intersections and we examined the differences between various scenarios. We found that avoiding a stop can reduce $CO_2$ and $NO_x$ emissions on 0.32 kg and 1.8 g, respectively. These results put traffic control in the main scene as a yet unexplored dimension to control pollutant emissions, enabling the authorities to more accurately estimate cost-benefit plans for traffic control system investments.


title: Solving Rubik's Cube via Quantum Mechanics and Deep Reinforcement Learning

abstract: Rubik's Cube is one of the most famous combinatorial puzzles involving nearly $4.3 \times 10^{19}$ possible configurations. Its mathematical description is expressed by the Rubik's group, whose elements define how its layers rotate. We develop a unitary representation of such group and a quantum formalism to describe the Cube from its geometrical constraints. Cubies are describedby single particle states which turn out to behave like bosons for corners and fermions for edges, respectively. When in its solved configuration, the Cube, as a geometrical object, shows symmetrieswhich are broken when driven away from this configuration. For each of such symmetries, we build a Hamiltonian operator. When a Hamiltonian lies in its ground state, the respective symmetry of the Cube is preserved. When all such symmetries are preserved, the configuration of the Cube matches the solution of the game. To reach the ground state of all the Hamiltonian operators, we make use of a Deep Reinforcement Learning algorithm based on a Hamiltonian reward. The Cube is solved in four phases, all based on a respective Hamiltonian reward based on its spectrum, inspired by the Ising model. Embedding combinatorial problems into the quantum mechanics formalism suggests new possible algorithms and future implementations on quantum hardware.


title: Multipoint interplanetary coronal mass ejections observed with Solar Orbiter, BepiColombo, Parker Solar Probe, Wind and STEREO-A

abstract: We report the result of the first search for multipoint in situ and imaging observations of interplanetary coronal mass ejections (ICMEs) starting with the first Solar Orbiter (SolO) data in 2020 April - 2021 April. A data exploration analysis is performed including visualizations of the magnetic field and plasma observations made by the five spacecraft SolO, BepiColombo, Parker Solar Probe (PSP), Wind and STEREO-A, in connection with coronagraph and heliospheric imaging observations from STEREO-A/SECCHI and SOHO/LASCO. We identify ICME events that could be unambiguously followed with the STEREO-A heliospheric imagers during their interplanetary propagation to their impact at the aforementioned spacecraft, and look for events where the same ICME is seen in situ by widely separated spacecraft. We highlight two events: (1) a small streamer blowout CME on 2020 June 23 observed with a triple lineup by PSP, BepiColombo and Wind, guided by imaging with STEREO-A, and (2) the first fast CME of solar cycle 25 ($ \approx 1600$ km s$^{-1}$) on 2020 November 29 observed in situ by PSP and STEREO-A. These results are useful for modeling the magnetic structure of ICMEs and the interplanetary evolution and global shape of their flux ropes and shocks, and for studying the propagation of solar energetic particles. The combined data from these missions are already turning out to be a treasure trove for space weather research and are expected to become even more valuable with an increasing number of ICME events expected during the rise and maximum of solar cycle 25.


title: Expectable Motion Unit: Avoiding Hazards From Human Involuntary Motions in Human-Robot Interaction

abstract: In robotics, many control and planning schemes have been developed to ensure human physical safety in human-robot interaction. The human psychological state and the expectation towards the robot, however, are typically neglected. Even if the robot behaviour is regarded as biomechanically safe, humans may still react with a rapid involuntary motion (IM) caused by a startle or surprise. Such sudden, uncontrolled motions can jeopardize safety and should be prevented by any means. In this letter, we propose the Expectable Motion Unit (EMU), which ensures that a certain probability of IM occurrence is not exceeded in a typical HRI setting. Based on a model of IM occurrence generated through an experiment with 29 participants, we establish the mapping between robot velocity, robot-human distance, and the relative frequency of IM occurrence. This mapping is processed towards a real-time capable robot motion generator that limits the robot velocity during task execution if necessary. The EMU is combined in a holistic safety framework that integrates both the physical and psychological safety knowledge. A validation experiment showed that the EMU successfully avoids human IM in five out of six cases.


title: Deep 3D Mesh Watermarking with Self-Adaptive Robustness

abstract: Robust 3D mesh watermarking is a traditional research topic in computer graphics, which provides an efficient solution to the copyright protection for 3D meshes. Traditionally, researchers need manually design watermarking algorithms to achieve sufficient robustness for the actual application scenarios. In this paper, we propose the first deep learning-based 3D mesh watermarking framework, which can solve this problem once for all. In detail, we propose an end-to-end network, consisting of a watermark embedding sub-network, a watermark extracting sub-network and attack layers. We adopt the topology-agnostic graph convolutional network (GCN) as the basic convolution operation for 3D meshes, so our network is not limited by registered meshes (which share a fixed topology). For the specific application scenario, we can integrate the corresponding attack layers to guarantee adaptive robustness against possible attacks. To ensure the visual quality of watermarked 3D meshes, we design a curvature-based loss function to constrain the local geometry smoothness of watermarked meshes. Experimental results show that the proposed method can achieve more universal robustness and faster watermark embedding than baseline methods while guaranteeing comparable visual quality.


title: Sentiment Analysis in Poems in Misurata Sub-dialect -- A Sentiment Detection in an Arabic Sub-dialect

abstract: Over the recent decades, there has been a significant increase and development of resources for Arabic natural language processing. This includes the task of exploring Arabic Language Sentiment Analysis (ALSA) from Arabic utterances in both Modern Standard Arabic (MSA) and different Arabic dialects. This study focuses on detecting sentiment in poems written in Misurata Arabic sub-dialect spoken in Misurata, Libya. The tools used to detect sentiment from the dataset are Sklearn as well as Mazajak sentiment tool 1. Logistic Regression, Random Forest, Naive Bayes (NB), and Support Vector Machines (SVM) classifiers are used with Sklearn, while the Convolutional Neural Network (CNN) is implemented with Mazajak. The results show that the traditional classifiers score a higher level of accuracy as compared to Mazajak which is built on an algorithm that includes deep learning techniques. More research is suggested to analyze Arabic sub-dialect poetry in order to investigate the aspects that contribute to sentiments in these multi-line texts; for example, the use of figurative language such as metaphors.


title: Experimental implementation of a neural network optical channel equalizer in restricted hardware using pruning and quantization

abstract: The deployment of artificial neural networks-based optical channel equalizers on edge-computing devices is critically important for the next generation of optical communication systems. However, this is still a highly challenging problem, mainly due to the computational complexity of the artificial neural networks (NNs) required for the efficient equalization of nonlinear optical channels with large dispersion-induced memory. To implement the NN-based optical channel equalizer in hardware, a substantial complexity reduction is needed, while we have to keep an acceptable performance level of the simplified NN model. In this work, we address the complexity reduction problem by applying pruning and quantization techniques to an NN-based optical channel equalizer. We use an exemplary NN architecture, the multi-layer perceptron (MLP), to mitigate the impairments for 30GBd 1000km transmission over a standard single-mode fiber, and demonstrate that it is feasible to reduce the equalizer's memory by up to 87.12%, and its complexity by up to 78.34%, without noticeable performance degradation. In addition to this, we accurately define the computational complexity of a compressed NN-based equalizer in the digital signal processing (DSP) sense. Further, we examine the impact of using different CPU and GPU settings on the power consumption and latency for the compressed equalizer. We also verify the developed technique experimentally, by implementing the reduced NN equalizer on two standard edge-computing hardware units: Raspberry Pi 4 and Nvidia Jetson Nano, which are used to process the data generated via simulating the signal's propagation down the optical-fiber system.


title: A Relation-Oriented Clustering Method for Open Relation Extraction

abstract: The clustering-based unsupervised relation discovery method has gradually become one of the important methods of open relation extraction (OpenRE). However, high-dimensional vectors can encode complex linguistic information which leads to the problem that the derived clusters cannot explicitly align with the relational semantic classes. In this work, we propose a relation-oriented clustering model and use it to identify the novel relations in the unlabeled data. Specifically, to enable the model to learn to cluster relational data, our method leverages the readily available labeled data of pre-defined relations to learn a relation-oriented representation. We minimize distance between the instance with same relation by gathering the instances towards their corresponding relation centroids to form a cluster structure, so that the learned representation is cluster-friendly. To reduce the clustering bias on predefined classes, we optimize the model by minimizing a joint objective on both labeled and unlabeled data. Experimental results show that our method reduces the error rate by 29.2% and 15.7%, on two datasets respectively, compared with current SOTA methods.


title: Signaling Design for Cooperative Resource Allocation and its Impact to Reliability

abstract: Decentralized cooperative resource allocation schemes for robotic swarms are essential to enable high reliability in high throughput data exchanges. These cooperative schemes require control signaling with the aim to avoid half-duplex problems at the receiver and mitigate interference. We propose two cooperative resource allocation schemes, device sequential and group scheduling, and introduce a control signaling design. We observe that failure in the reception of these control signals leads to non-cooperative behavior and to significant performance degradation. The cause of these failures are identified and specific countermeasures are proposed and evaluated. We compare the proposed resource allocation schemes against the NR sidelink mode 2 resource allocation and show that even though signaling has an important impact on the resource allocation performance, our proposed device sequential and group scheduling resource allocation schemes improve reliability by an order of magnitude compared to sidelink mode 2.


title: Fusing Visuo-Tactile Perception into Kernelized Synergies for Robust Grasping and Fine Manipulation of Non-rigid Objects

abstract: Handling non-rigid objects using robot hands necessities a framework that does not only incorporate human-level dexterity and cognition but also the multi-sensory information and system dynamics for robust and fine interactions. In this research, our previously developed kernelized synergies framework, inspired from human behaviour on reusing same subspace for grasping and manipulation, is augmented with visuo-tactile perception for autonomous and flexible adaptation to unknown objects. To detect objects and estimate their poses, a simplified visual pipeline using RANSAC algorithm with Euclidean clustering and SVM classifier is exploited. To modulate interaction efforts while grasping and manipulating non-rigid objects, the tactile feedback using T40S shokac chip sensor, generating 3D force information, is incorporated. Moreover, different kernel functions are examined in the kernelized synergies framework, to evaluate its performance and potential against task reproducibility, execution, generalization and synergistic re-usability. Experiments performed with robot arm-hand system validates the capability and usability of upgraded framework on stably grasping and dexterously manipulating the non-rigid objects.


title: Channel Estimation Based on Machine Learning Paradigm for Spatial Modulation OFDM

abstract: In this paper, deep neural network (DNN) is integrated with spatial modulation-orthogonal frequency division multiplexing (SM-OFDM) technique for end-to-end data detection over Rayleigh fading channel. This proposed system directly demodulates the received symbols, leaving the channel estimation done only implicitly. Furthermore, an ensemble network is also proposed for this system. Simulation results show that the proposed DNN detection scheme has a significant advantage over classical methods when the pilot overhead and cyclic prefix (CP) are reduced, owing to its ability to learn and adjust to complicated channel conditions. Finally, the ensemble network is shown to improve the generalization of the proposed scheme, while also showing a slight improvement in its performance.


title: Some New Congruences Modulo Powers of 2 For $(j,k)$-Regular Overpartition

abstract: Let $\overline{p}_{j,k}(n)$ denotes the number of $(j,k)$-regular overpartitions of a positive integer $n$ such that none of the parts is congruent to $j$ modulo $k$. Naika et. al. (2021) proved infinite families of congruences modulo powers of 2 for $\overline{p}_{3,6}(n)$, $\overline{p}_{5,10}(n)$ and $\overline{p}_{9,18}(n)$. In this paper, we obtain infinite families of congruences modulo power of 2 for $\overline{p}_{4,8}(n)$, $\overline{p}_{6,12}(n)$ and $\overline{p}_{8,16}(n)$. For example, we prove that, for all integers $n\geq 0$ and $\alpha\geq 0$, $$ \overline{p}_{4,8}\left( 5^{2\alpha+1}\left( 16(5n+j)+14\right) \right) q^n\equiv 0\pmod{64}; \qquad j=1,2,3,4.$$


title: Life-Long Multi-Task Learning of Adaptive Path Tracking Policy for Autonomous Vehicle

abstract: This paper proposes a life-long adaptive path tracking policy learning method for autonomous vehicles that can self-evolve and self-adapt with multi-task knowledge. Firstly, the proposed method can learn a model-free control policy for path tracking directly from the historical driving experience, where the property of vehicle dynamics and corresponding control strategy can be learned simultaneously. Secondly, by utilizing the life-long learning method, the proposed method can learn the policy with task-incremental knowledge without encountering catastrophic forgetting. Thus, with continual multi-task knowledge learned, the policy can iteratively adapt to new tasks and improve its performance with knowledge from new tasks. Thirdly, a memory evaluation and updating method is applied to optimize memory structure for life-long learning which enables the policy to learn toward selected directions. Experiments are conducted using a high-fidelity vehicle dynamic model in a complex curvy road to evaluate the performance of the proposed method. Results show that the proposed method can effectively evolve with continual multi-task knowledge and adapt to the new environment, where the performance of the proposed method can also surpass two commonly used baseline methods after evolving.


title: Risk Measurement, Risk Entropy, and Autonomous Driving Risk Modeling

abstract: It has been for a long time to use big data of autonomous vehicles for perception, prediction, planning, and control of driving. Naturally, it is increasingly questioned why not using this big data for risk management and actuarial modeling. This article examines the emerging technical difficulties, new ideas, and methods of risk modeling under autonomous driving scenarios. Compared with the traditional risk model, the novel model is more consistent with the real road traffic and driving safety performance. More importantly, it provides technical feasibility for realizing risk assessment and car insurance pricing under a computer simulation environment.


title: Optimising Rolling Stock Planning including Maintenance with Constraint Programming and Quantum Annealing

abstract: We propose and compare Constraint Programming (CP) and Quantum Annealing (QA) approaches for rolling stock assignment optimisation considering necessary maintenance tasks. In the CP approach, we model the problem with an Alldifferent constraint, extensions of the Element constraint, and logical implications, among others. For the QA approach, we develop a quadratic unconstrained binary optimisation (QUBO) model. For evaluation, we use data sets based on real data from Deutsche Bahn and run the QA approach on real quantum computers from D-Wave. Classical computers are used to evaluate the CP approach as well as tabu search for the QUBO model. At the current development stage of the physical quantum annealers, we find that both approaches tend to produce comparable results.


title: Hierarchical Electricity and Carbon Trading in Transmission and Distribution Networks Based on Virtual Federated Prosumer

abstract: Facing the dilemma of growing energy demand and mitigating carbon emissions, this paper proposes an energy sharing mechanism based on virtual federated prosumers (VFPs) with budget allocation for joint electricity and carbon market to incentivize distributed energy resources to participate in the hierarchical market and reduce carbon emissions. At the transmission level, the regional transmission operator coordinates transactions between two markets, the inter-VFP energy sharing market and the wholesale market, intending to minimize the overall cost of VFPs. The energy sharing market clearing problem is formulated as a generalized Nash game, for which we develop a first-order response algorithm to obtain the equilibrium. At the distribution level, the VFPs play the role of selfless auctioneer that leverage discriminatory weights and benchmark prices to allocate the electricity-carbon budget among entities in the VFP to maximize social welfare. The Nash game is exploited to characterize the budget allocation problem, for which a distributed feedback allocation algorithm is proposed. The entire hierarchical electricity and carbon trading is modeled as an equilibrium problem and is solved iteratively. Case studies based on a practical regional grid verify the effectiveness of the proposed algorithm and show that the mechanism is effective in improving energy efficiency and reducing carbon emissions.


title: On homogeneity of Cantor cubes

abstract: It is established that any homeomorphism between two closed negligible subset of $D^\tau$ can be extended to an autohomeomorphism of $D^\tau$.


title: Momentum relaxation in a holographic Weyl semimetal

abstract: We study the effects of momentum relaxation on the holographic Weyl semimetal which exhibits a topological quantum phase transition between the Weyl semimetal phase and a topological trivial phase. The conservation of momentum in the field theory is broken by the axion fields in holography. The topological Weyl semimetal phase is characterized by a nontrivial anomalous Hall conductivity. We find that the critical value of the phase transition decreases when we increase the momentum relaxation strength up to a special value, above which it goes to zero. This indicates that the Weyl semimetal phase shrinks and finally disappears as the momentum relaxation strength is increased, which is consistent with the weakly coupled field theory predictions. We also study the behavior of transverse/longitudinal conductivities and low temperature dependence of the d.c.resistivities with respect to momentum relaxation strength.


title: BV right-continuous solutions of second-order differential inclusions governed by maximal monotone operators

abstract: This paper concerns existence of right-continuous with bounded variation solutions of a perturbed second-order differential inclusion governed by time and state-dependent maximal monotone operators.


title: Progressive Hard-case Mining across Pyramid Levels for Object Detection

abstract: In object detection, multi-level prediction (e.g., FPN) and reweighting skills (e.g., focal loss) have drastically improved one-stage detector performance. However, the synergy between these two techniques is not fully explored in a unified framework. We find that, during training, the one-stage detector's optimization is not only restricted to the static hard-case mining loss (gradient drift) but also suffered from the diverse positive samples' proportions split by different pyramid levels (level discrepancy). Under this concern, we propose Hierarchical Progressive Focus (HPF) consisting of two key designs: 1) progressive focus, a more flexible hard-case mining setting calculated adaptive to the convergence progress, 2) hierarchical sampling, automatically generating a set of progressive focus for level-specific target optimization. Based on focal loss with ATSS-R50, our approach achieves 40.5 AP, surpassing the state-of-the-art QFL (Quality Focal Loss, 39.9 AP) and VFL (Varifocal Loss, 40.1 AP). Our best model achieves 55.1 AP on COCO test-dev, obtaining excellent results with only a typical training setting. Moreover, as a plug-and-play scheme, HPF can cooperate well with recent advances, providing a stable performance improvement on nine mainstream detectors.


title: Limitations of the Invertible-Map Equivalences

abstract: This note draws conclusions that arise by combining two recent papers, by Anuj Dawar, Erich Gr\"adel, and Wied Pakusa, published at ICALP 2019 and by Moritz Lichter, published at LICS 2021. In both papers, the main technical results rely on the combinatorial and algebraic analysis of the invertible-map equivalences $\equiv^\text{IM}_{k,Q}$ on certain variants of Cai-F\"urer-Immerman (CFI) structures. These $\equiv^\text{IM}_{k,Q}$-equivalences, for a number $k$ and a set of primes~$Q$, refine the well-known Weisfeiler-Leman equivalences used in algorithms for graph isomorphism. The intuition is that two graphs $G\equiv^\text{IM}_{k,Q}H$ cannot be distinguished by iterative refinements of equivalences on $k$-tuples defined via linear operators on vector spaces over fields of characteristic $p \in Q$. In the first paper it has been shown, using considerable algebraic machinery, that for a prime $q \notin Q$, the $\equiv^\text{IM}_{k,Q}$ equivalences do not distinguish between non-isomorphic CFI-structures over the field $\mathbb{F}_q$. In the second paper, a similar but not identical construction for CFI-structures over the rings $\mathbb{Z}_{2^i}$ has, again by rather involved combinatorial and algebraic arguments, been shown to be indistinguishable with respect to $\equiv^\text{IM}_{k,\{2\}}$. Together with earlier work, this second result separates rank logic from polynomial time. We unify the two approaches and prove that CFI-structures over the rings $\mathbb{Z}_{2^i}$ are indistinguishable with respect to $\equiv^\text{IM}_{k,\mathbb{P}}$, for the set $\mathbb{P}$ of all primes. This implies the following two results. 1. There is no fixed $k$ such that the invertible-map equivalence $\equiv^\text{IM}_{k,\mathbb{P}}$ coincides with isomorphism on all finite graphs. 2. No extension of fixed-point logic by linear-algebraic operators over fields can capture polynomial time.


title: Ro-Vibrational Hamiltonian of Three Body Systems Near Collinear Configurations

abstract: Recent developments on three body systems have revealed that dynamics of trajectories passing through collinear configurations can be easily adopted. We analyse the reduction procedure in order to detect the points where collinear configurations are deviating. Then we show that the value of the reduced Hamiltonian can be computed at these points.


title: Non-reciprocal wave propagation in space-time modulated media

abstract: We prove the possibility of achieving non-reciprocal wave propagation in space-time modulated media and give an asymptotic analysis of the non-reciprocity property in terms of the amplitude of the time-modulation. Such modulation causes a folding of the band structure of the material, which may induce degenerate points. By breaking time-reversal symmetry, we show that these degeneracies may open into non-symmetric, unidirectional band gaps. Finally we illustrate our results by several numerical simulations.

categories: math.AP cond-mat.mtrl-sci math-ph math.MP


title: In search of infall motion in molecular clumps III: HCO+ (1-0) and H13CO+ (1-0) mapping observations toward the confirmed infall sources

abstract: The study of infall motion helps us to understand the initial stages of star formation. In this paper, we use the IRAM 30-m telescope to make mapping observations of 24 infall sources confirmed in previous work. The lines we use to track gas infall motions are HCO+ (1-0) and H13CO+ (1-0). All 24 sources show HCO+ emissions, while 18 sources show H13CO+ emissions. The HCO+ integrated intensity maps of 17 sources show clear clumpy structures; for the H13CO+ line, 15 sources show clumpy structures. We estimated the column density of HCO+ and H13CO+ using the RADEX radiation transfer code, and the obtained [HCO+]/[H2] and [H13CO+]/[HCO+] of these sources are about 10^-11 ~ 10^-7 and 10^-3~1, respectively. Based on the asymmetry of the line profile of the HCO+, we distinguish these sources: 19 sources show blue asymmetric profiles, and the other sources show red profiles or symmetric peak profiles. For eight sources that have double-peaked blue line profiles and signal-to-noise ratios greater than 10, the RATRAN model is used to fit their HCO^+ (1-0) lines, and to estimate their infall parameters. The mean Vin of these sources are 0.3 ~ 1.3 km/s, and the Min are about 10^-3 ~ 10^-4 Msun/yr , which are consistent with the results of intermediate or massive star formation in previous studies. The Vin estimated from the Myers model are 0.1 ~ 1.6 km/s, and the Min are within 10^-3 ~ 10^-5 Msun/yr. In addition, some identified infall sources show other star-forming activities, such as outflows and maser emissions. Especially for those sources with a double-peaked blue asymmetric profile, most of them have both infall and outflow evidence.


title: EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation

abstract: Pre-trained language models have shown remarkable results on various NLP tasks. Nevertheless, due to their bulky size and slow inference speed, it is hard to deploy them on edge devices. In this paper, we have a critical insight that improving the feed-forward network (FFN) in BERT has a higher gain than improving the multi-head attention (MHA) since the computational cost of FFN is 2$\sim$3 times larger than MHA. Hence, to compact BERT, we are devoted to designing efficient FFN as opposed to previous works that pay attention to MHA. Since FFN comprises a multilayer perceptron (MLP) that is essential in BERT optimization, we further design a thorough search space towards an advanced MLP and perform a coarse-to-fine mechanism to search for an efficient BERT architecture. Moreover, to accelerate searching and enhance model transferability, we employ a novel warm-up knowledge distillation strategy at each search stage. Extensive experiments show our searched EfficientBERT is 6.9$\times$ smaller and 4.4$\times$ faster than BERT$\rm_{BASE}$, and has competitive performances on GLUE and SQuAD Benchmarks. Concretely, EfficientBERT attains a 77.7 average score on GLUE \emph{test}, 0.7 higher than MobileBERT$\rm_{TINY}$, and achieves an 85.3/74.5 F1 score on SQuAD v1.1/v2.0 \emph{dev}, 3.2/2.7 higher than TinyBERT$_4$ even without data augmentation. The code is released at https://github.com/cheneydon/efficient-bert.


title: An orthotropic plate model for decks of suspension bridges

abstract: The main purpose of the present paper is to compare two different kinds of approaches in modeling the deck of a suspension bridge: in the first approach we look at the deck as a rectangular plate and in the second one we look at the deck as a beam for vertical deflections and as a rod for torsional deformations. Throughout this paper we will refer to the model corresponding to the second approach as the \textit{beam-rod model}. In our discussion, we observe that the beam-rod model has more \textit{degrees of freedom} if compared with the isotropic plate model. For this reason the beam-rod model is supposed to be more appropiate to describe the behavior of the deck of a real suspension bridge. A possible strategy to make the plate model more efficient could be to relax the isotropy condition with a more general condition of orthotropy, which is expected to increase the degrees of freedom in view of the larger number of elastic parameters. In this new setting, a comparison between the two approaches becomes now possible. Basic results are proved for the suggested problem, from existence and uniqueness of solutions to spectral properties. We suggest realistic values for the elastic parameters thus obtaining with both approaches similar responses in the static and dynamic behavior of the deck. This can be considered as a preliminary article since many work has still to be done with the perspective of formulating models for a complete suspension bridge which take into account not only the deck but also the action on it of cables and hangers. With this perspective, a section is devoted to possible future developments.


title: On control measures of multimeasures

abstract: Let $M$ be a multimeasure defined on a $\sigma$-algebra and taking values in the family of bounded non-empty subsets of a Banach space $X$. We prove that $M$ admits a control measure whenever $X$ contains no subspace isomorphic to $c_0(\omega_1)$. The additional assumption on $X$ is shown to be essential.


title: Longitudinal asymmetry in heavy ion collisions at RHIC

abstract: The longitudinal asymmetry arises in relativistic heavy ion collisions due to fluctuation in the number of participating nucleons. This asymmetry causes a shift in the center of mass rapidity of the participant zone. The rapidity shift as well as the longitudinal asymmetry have been found to be significant at the top LHC energy for collisions of identical nuclei. We study the longitudinal asymmetry and its effect on charged particle rapidity distribution and anisotropic flow parameters at relatively lower RHIC energies using a model calculation. The rapidity shift is found to be more pronounced for peripheral collisions, smaller systems and also for lower beam energies due to longitudinal asymmetry. A detailed study has been done by associating the average rapidity shift to a polynomial relation where the coefficients of this polynomial characterize the effect of the asymmetry. We show that the rapidity shift may affect observables significantly at RHIC energies.


title: Reinforcement Learning vs. Gradient-Based Optimisation for Robust Energy Landscape Control of Spin-1/2 Quantum Networks

abstract: We explore the use of policy gradient methods in reinforcement learning for quantum control via energy landscape shaping of XX-Heisenberg spin chains in a model agnostic fashion. Their performance is compared to finding controllers using gradient-based L-BFGS optimisation with restarts, with full access to an analytical model. Hamiltonian noise and coarse-graining of fidelity measurements are considered. Reinforcement learning is able to tackle challenging, noisy quantum control problems where L-BFGS optimization algorithms struggle to perform well. Robustness analysis under different levels of Hamiltonian noise indicates that controllers found by reinforcement learning appear to be less affected by noise than those found with L-BFGS.


title: How Much do Lyrics Matter? Analysing Lyrical Simplicity Preferences for Individuals At Risk of Depression

abstract: Music affects and in some cases reflects one's emotional state. Key to this influence is lyrics and their meaning in conjunction with the acoustic properties of the track. Recent work has focused on analysing these acoustic properties and showing that individuals prone to depression primarily consume low valence and low energy music. However, no studies yet have explored lyrical content preferences in relation to online music consumption of such individuals. In the current study, we examine lyrical simplicity, measured as the Compressibility and Absolute Information Content of the text, associated with preferences of individuals at risk for depression. Using the six-month listening history of 541 Last.fm users, we compare lyrical simplicity trends for users grouped as being at risk (At-Risk) of depression from those that are not (No-Risk). Our findings reveal that At-Risk individuals prefer songs with greater information content (lower Compressibility) on average, especially for songs characterised as Sad. Furthermore, we found that At-Risk individuals also have greater variability of Absolute Information Content across their listening history. We discuss the results in light of existing socio-psychological lab-based research on music habits associated with depression and their relevance to naturally occurring online music listening behaviour.


title: Dialog speech sentiment classification for imbalanced datasets

abstract: Speech is the most common way humans express their feelings, and sentiment analysis is the use of tools such as natural language processing and computational algorithms to identify the polarity of these feelings. Even though this field has seen tremendous advancements in the last two decades, the task of effectively detecting under represented sentiments in different kinds of datasets is still a challenging task. In this paper, we use single and bi-modal analysis of short dialog utterances and gain insights on the main factors that aid in sentiment detection, particularly in the underrepresented classes, in datasets with and without inherent sentiment component. Furthermore, we propose an architecture which uses a learning rate scheduler and different monitoring criteria and provides state-of-the-art results for the SWITCHBOARD imbalanced sentiment dataset.


title: Tuning nonlinear second-harmonic generation in AlGaAs nanoantennas via chalcogenide phase change material

abstract: The ability to engineer nonlinear optical processes in all-dielectric nanostructures is both of fundamental interest and highly desirable for high-performance, robust, and miniaturized nonlinear optical devices. Herein, we propose a novel paradigm for the efficient tuning of second-harmonic generation (SHG) process in dielectric nanoantennas by integrating with chalcogenide phase change material. In a design with Ge$_{2}$Sb$_{2}$Te$_{5}$ (GST) film sandwiched between the AlGaAs nanoantennas and AlO$_{x}$ substrate, the nonlinear SHG signal from the AlGaAs nanoantennas can be boosted via the resonantly localized field induced by the optically-induced Mie-type resonances, and further modulated by exploiting the GST amorphous-to-crystalline phase change in a non-volatile, multi-level manner. The tuning strategy originates from the modulation of resonant conditions by changes in the refractive index of GST. With a thorough examination of tuning performances for different nanoantenna radii, a maximum modulation depth as high as 540$\%$ is numerically demonstrated. This work not only reveals out the potential of GST in optical nonlinearity control, but also provides promising strategy in smart designing tunable and reconfigurable nonlinear optical devices, e.g., light emitters, modulators, and sensors.


title: Learning Mathematical Properties of Integers

abstract: Embedding words in high-dimensional vector spaces has proven valuable in many natural language applications. In this work, we investigate whether similarly-trained embeddings of integers can capture concepts that are useful for mathematical applications. We probe the integer embeddings for mathematical knowledge, apply them to a set of numerical reasoning tasks, and show that by learning the representations from mathematical sequence data, we can substantially improve over number embeddings learned from English text corpora.


title: SWEAT: Scoring Polarization of Topics across Different Corpora

abstract: Understanding differences of viewpoints across corpora is a fundamental task for computational social sciences. In this paper, we propose the Sliced Word Embedding Association Test (SWEAT), a novel statistical measure to compute the relative polarization of a topical wordset across two distributional representations. To this end, SWEAT uses two additional wordsets, deemed to have opposite valence, to represent two different poles. We validate our approach and illustrate a case study to show the usefulness of the introduced measure.


title: Sputtered 2D transition metal dichalcogenides: from growth to device applications

abstract: Starting from graphene, 2D layered materials family has been recently set up more than 100 different materials with variety of different class of materials such as semiconductors, metals, semimetals, superconductors. Among these materials, 2D semiconductors have found especial importance in the state of the art device applications compared to that of the current conventional devices such as (which material based for example Si based) field effect transistors (FETs) and photodetectors during the last two decades. This high potential in solid state devices is mostly revealed by the transition metal dichalcogenides (TMDCs) semiconductor materials such as MoS2 , WS2 , MoSe2 and WSe2 . Therefore, many different methods and approaches have been developed to grow or obtain so far in order to make use them in solid state devices, which is a great challenge in large area applications. Although there are intensively studied methods such as chemical vapor deposition (CVD), mechanical exfoliation, atomic layer deposition, it is sputtering getting attention day by day due to the simplicity of the growth method together with its reliability, large area growth possibility and repeatability. In this review article, we provide benefits and disadvantages of all the growth methods when growing TMDC materials, then focusing on the sputtering TMDC growth strategies performed. In addition, TMDCs for the FETs and photodetector devices grown by RFMS have been surveyed.


title: The fate of Landau levels under $\delta$-interactions

abstract: We consider the self-adjoint Landau Hamiltonian $H_0$ in $L^2(\mathbb{R}^2)$ whose spectrum consists of infinitely degenerate eigenvalues $\Lambda_q$, $q \in \mathbb{Z}_+$, and the perturbed operator $H_\upsilon = H_0 + \upsilon\delta_\Gamma$, where $\Gamma \subset \mathbb{R}^2$ is a regular Jordan $C^{1,1}$-curve, and $\upsilon \in L^p(\Gamma;\mathbb{R})$, $p>1$, has a constant sign. We investigate ${\rm Ker}(H_\upsilon -\Lambda_q)$, $q \in \mathbb{Z}_+$, and show that generically $$0 \leq {\rm dim \, Ker}(H_\upsilon -\Lambda_q) - {\rm dim \, Ker}(T_q(\upsilon \delta_\Gamma)) < \infty,$$ where $T_q(\upsilon \delta_\Gamma) = p_q (\upsilon \delta_\Gamma)p_q$, is an operator of Berezin-Toeplitz type, acting in $p_q L^2(\mathbb{R}^2)$, and $p_q$ is the orthogonal projection on ${\rm Ker}\,(H_0 -\Lambda_q)$. If $\upsilon \neq 0$ and $q = 0$, we prove that ${\rm Ker}\,(T_0(\upsilon \delta_\Gamma)) = \{0\}$. If $q \geq 1$, and $\Gamma = \mathcal{C}_r$ is a circle of radius $r$, we show that ${\rm dim \, Ker} (T_q(\delta_{\mathcal{C}_r})) \leq q$, and the set of $r \in (0,\infty)$ for which ${\rm dim \, Ker}(T_q(\delta_{\mathcal{C}_r})) \geq 1$, is infinite and discrete.


title: The Unreasonable Effectiveness of the Baseline: Discussing SVMs in Legal Text Classification

abstract: We aim to highlight an interesting trend to contribute to the ongoing debate around advances within legal Natural Language Processing. Recently, the focus for most legal text classification tasks has shifted towards large pre-trained deep learning models such as BERT. In this paper, we show that a more traditional approach based on Support Vector Machine classifiers reaches surprisingly competitive performance with BERT-based models on the classification tasks in the LexGLUE benchmark. We also highlight that error reduction obtained by using specialised BERT-based models over baselines is noticeably smaller in the legal domain when compared to general language tasks. We present and discuss three hypotheses as potential explanations for these results to support future discussions.


title: Artificial Neural Networks for cosmic gamma-ray propagation in the Universe

abstract: We explore the potential of an artificial neural network (ANN) based method intelligence to probe the propagation of cosmic $\gamma$-ray photons in the extragalactic Universe. The journey of $\gamma$-rays emitted from a distant source like blazar to the observer at the Earth is impeded by the absorption through the interaction with the extragalactic background light (EBL), leading to an electron-positron pair production. This process dominates for gamma ray photons with energy above 10 GeV propagating over the cosmological distances. The effect of $\gamma$-ray attenuation is characterized by a physical quantity called \emph{optical depth}, which strongly depends on the $\gamma$-ray photon energy, redshift of the source, and density of the EBL photons. We estimate the optical depth values for $\gamma$-ray energies above 10 GeV emitted from the sources at redshifts in the range 0.01 to 1 using three different and most promising EBL models. These optical depth estimates are randomly divided into two data sets for training and testing of the ANN using energy, redshift as inputs and optical depth as output. The optimization of ANN-performance for each EBL model employs standard back-propagation (BP) and radial-basis function (RBF) algorithms. The performance of the ANN model using the RBF is found to be superior to the BP method. In particular, the RBF-ANN with 40 neurons in the hidden layer corresponding to the EBL model proposed by Finke et al. (2010) shows the best performance for the propagation of $\gamma$-rays in the Universe.


title: Recursive Hierarchical Projection for Whole-Body Control with Task Priority Transition

abstract: Redundant robots are desired to execute multitasks with different priorities simultaneously. The task priorities are necessary to be transitioned for complex task scheduling of whole-body control (WBC). Many methods focused on guaranteeing the control continuity during task priority transition, however either increased the computation consumption or sacrificed the accuracy of tasks inevitably. This work formulates the WBC problem with task priority transition as an Hierarchical Quadratic Programming (HQP) with Recursive Hierarchical Projection (RHP) matrices. The tasks of each level are solved recursively through HQP. We propose the RHP matrix to form the continuously changing projection of each level so that the task priority transition is achieved without increasing computation consumption. Additionally, the recursive approach solves the WBC problem without losing the accuracy of tasks. We verify the effectiveness of this scheme by the comparative simulations of the reactive collision avoidance through multi-tasks priority transitions.


title: Coulomb Branch Global Symmetry and Quiver Addition

abstract: To date, the best effort made to simply determine the Coulomb branch global symmetry of a theory from a $3d$ $\mathcal{N}=4$ quiver is by applying an algorithm based on its balanced gauge nodes. This often gives the full global symmetry, but there have been many cases seen where it instead gives only a subgroup. This paper presents a method for constructing several families of $3d$ $\mathcal{N}=4$ unitary quivers where the true global symmetry is enhanced from that predicted by the balance algorithm, motivated by the study of Coulomb branch Hasse diagrams. This provides a rich list of examples on which to test improved algorithms for unfailingly identifying the Coulomb branch global symmetry from a quiver.


title: Double scaling limit for the $O(N)^3$-invariant tensor model

abstract: We study the double scaling limit of the $O(N)^3$-invariant tensor model, initially introduced in Carrozza and Tanasa, Lett. Math. Phys. (2016). This model has an interacting part containing two types of quartic invariants, the tetrahedric and the pillow one. For the 2-point function, we rewrite the sum over Feynman graphs at each order in the $1/N$ expansion as a \emph{finite} sum, where the summand is a function of the generating series of melons and chains (a.k.a. ladders). The graphs which are the most singular in the continuum limit are characterized at each order in the $1/N$ expansion. This leads to a double scaling limit which picks up contributions from all orders in the $1/N$ expansion. In contrast with matrix models, but similarly to previous double scaling limits in tensor models, this double scaling limit is summable. The tools used in order to prove our results are combinatorial, namely a thorough diagrammatic analysis of Feynman graphs, as well as an analysis of the singularities of the relevant generating series.


title: Internet of Behavior (IoB) and Explainable AI Systems for Influencing IoT Behavior

abstract: Pandemics and natural disasters over the years have changed the behavior of people, which has had a tremendous impact on all life aspects. With the technologies available in each era, governments, organizations, and companies have used these technologies to track, control, and influence the behavior of individuals for a benefit. Nowadays, the use of the Internet of Things (IoT), cloud computing, and artificial intelligence (AI) have made it easier to track and change the behavior of users through changing IoT behavior. This article introduces and discusses the concept of the Internet of Behavior (IoB) and its integration with Explainable AI (XAI) techniques to provide trusted and evident experience in the process of changing IoT behavior to ultimately improving users' behavior. Therefore, a system based on IoB and XAI has been proposed in a use case scenario of electrical power consumption that aims to influence user consuming behavior to reduce power consumption and cost. The scenario results showed a decrease of 522.2 kW of active power when compared to original consumption over a 200-hours period. It also showed a total power cost saving of 95.04 Euro for the same period. Moreover, decreasing the global active power will reduce the power intensity through the positive correlation.


title: Nonlinear One-Dimensional Constitutive Model for Magnetostrictive Materials

abstract: This paper presents an analytic model of one dimensional magnetostriction. We show how specific assumptions regarding the symmetry of key micromagnetic energies (magnetocrystalline, magnetoelastic, and Zeeman) reduce a general three-dimensional statistical mechanics model to a one-dimensional form with an exact solution. We additionally provide a useful form of the analytic equations to help ensure numerical accuracy. Numerical results show that the model maintains accuracy over a large range of applied magnetic fields and stress conditions extending well outside those produced in standard laboratory conditions. A comparison to experimental data is performed for several magnetostrictive materials. The model is shown to accurately predict the behavior of Terfenol-D, while two compositions of Galfenol are modeled with varying accuracy. To conclude we discuss what conditions facilitate the description of materials with cubic crystalline anisotropy as transversely isotropic, to achieve peak model performance.


title: Reference-frame-independent design of phase-matching quantum key distribution

abstract: The recently proposed phase-matching quantum key distribution offers means to overcome the linear key rate-transmittance bound. Since the key information is encoded onto the phases of coherent states, the misalignment between the two remote reference frames would yield errors and significantly degrade the key generation rate from the ideal case. In this work, we propose a reference-frame-independent design of phase-matching quantum key distribution by introducing high-dimensional key encoding space. With encoded phases spanning the unit circle, the error statistics at arbitrary fixed phase reference difference can be recovered and treated separately, from which the misalignment angle can be identified. By naturally extending the binary encoding symmetry and complementarity to high dimensions, we present a security proof of this high-dimensional phase-matching quantum key distribution and demonstrate with simulation that a 17-dimensional protocol is completely immune to any degree of fixed misalignment and robust to slow phase fluctuations. We expect the high-dimensional protocol to be a practical reference-frame-independent design for general phase-encoding schemes where high-dimensional encoding is relatively easy to implement.


title: Regressive Ensemble for Machine Translation Quality Evaluation

abstract: This work introduces a simple regressive ensemble for evaluating machine translation quality based on a set of novel and established metrics. We evaluate the ensemble using a correlation to expert-based MQM scores of the WMT 2021 Metrics workshop. In both monolingual and zero-shot cross-lingual settings, we show a significant performance improvement over single metrics. In the cross-lingual settings, we also demonstrate that an ensemble approach is well-applicable to unseen languages. Furthermore, we identify a strong reference-free baseline that consistently outperforms the commonly-used BLEU and METEOR measures and significantly improves our ensemble's performance.


title: Enhancing Clinical Information Extraction with Transferred Contextual Embeddings

abstract: The Bidirectional Encoder Representations from Transformers (BERT) model has achieved the state-of-the-art performance for many natural language processing (NLP) tasks. Yet, limited research has been contributed to studying its effectiveness when the target domain is shifted from the pre-training corpora, for example, for biomedical or clinical NLP applications. In this paper, we applied it to a widely studied a hospital information extraction (IE) task and analyzed its performance under the transfer learning setting. Our application became the new state-of-the-art result by a clear margin, compared with a range of existing IE models. Specifically, on this nursing handover data set, the macro-average F1 score from our model was 0.438, whilst the previous best deep learning models had 0.416. In conclusion, we showed that BERT based pre-training models can be transferred to health-related documents under mild conditions and with a proper fine-tuning process.


title: A weighted one-level density of families of $L$-functions

abstract: This paper is devoted to a weighted version of the one-level density of the non-trivial zeros of $L$-functions, tilted by a power of the $L$-function evaluated at the central point. Assuming the Riemann Hypothesis and the ratio conjecture, for some specific families of $L$-functions we prove that the same structure suggested by the density conjecture holds also in this weighted investigation, if the exponent of the weight is small enough. Moreover we speculate about the general case, conjecturing explicit formulae for the weighted kernels.


title: Navigation-Oriented Scene Understanding for Robotic Autonomy: Learning to Segment Driveability in Egocentric Images

abstract: This work tackles scene understanding for outdoor robotic navigation, solely relying on images captured by an on-board camera. Conventional visual scene understanding interprets the environment based on specific descriptive categories. However, such a representation is not directly interpretable for decision-making and constrains robot operation to a specific domain. Thus, we propose to segment egocentric images directly in terms of how a robot can navigate in them, and tailor the learning problem to an autonomous navigation task. Building around an image segmentation network, we present a generic affordance consisting of 3 driveability levels which can broadly apply to both urban and off-road scenes. By encoding these levels with soft ordinal labels, we incorporate inter-class distances during learning which improves segmentation compared to standard "hard" one-hot labelling. In addition, we propose a navigation-oriented pixel-wise loss weighting method which assigns higher importance to safety-critical areas. We evaluate our approach on large-scale public image segmentation datasets ranging from sunny city streets to snowy forest trails. In a cross-dataset generalization experiment, we show that our affordance learning scheme can be applied across a diverse mix of datasets and improves driveability estimation in unseen environments compared to general-purpose, single-dataset segmentation.


title: RGB-D Saliency Detection via Cascaded Mutual Information Minimization

abstract: Existing RGB-D saliency detection models do not explicitly encourage RGB and depth to achieve effective multi-modal learning. In this paper, we introduce a novel multi-stage cascaded learning framework via mutual information minimization to "explicitly" model the multi-modal information between RGB image and depth data. Specifically, we first map the feature of each mode to a lower dimensional feature vector, and adopt mutual information minimization as a regularizer to reduce the redundancy between appearance features from RGB and geometric features from depth. We then perform multi-stage cascaded learning to impose the mutual information minimization constraint at every stage of the network. Extensive experiments on benchmark RGB-D saliency datasets illustrate the effectiveness of our framework. Further, to prosper the development of this field, we contribute the largest (7x larger than NJU2K) dataset, which contains 15,625 image pairs with high quality polygon-/scribble-/object-/instance-/rank-level annotations. Based on these rich labels, we additionally construct four new benchmarks with strong baselines and observe some interesting phenomena, which can motivate future model design. Source code and dataset are available at "https://github.com/JingZhang617/cascaded_rgbd_sod".


title: Towards Precise Pruning Points Detection using Semantic-Instance-Aware Plant Models for Grapevine Winter Pruning Automation

abstract: Grapevine winter pruning is a complex task, that requires skilled workers to execute it correctly. The complexity makes it time consuming. It is an operation that requires about 80-120 hours per hectare annually, making an automated robotic system that helps in speeding up the process a crucial tool in large-size vineyards. We will describe (a) a novel expert annotated dataset for grapevine segmentation, (b) a state of the art neural network implementation and (c) generation of pruning points following agronomic rules, leveraging the simplified structure of the plant. With this approach, we are able to generate a set of pruning points on the canes, paving the way towards a correct automation of grapevine winter pruning.


title: Rapidity Distribution within Landau hydrodynamical model and EPOS event-generator at RHIC Energies

abstract: The rapidity distribution of well-defined particles pions, Kaons, protons and their antiparticles measured in the BRAHMS experiment (Au+Au collisions), at $\sqrt{s_{NN}}$ = $62.4$ and $200$ GeV, are compared with huge statistical ensembles of 100, 000 events deduced from the Cosmic Ray MonteCarlo (CRMC) EPOS event-generator. All these data are then compared to the Landau hydrodynamical model. We conclude that the Landau hydrodynamical model is capable of describing both experimental data and EPOS $1.99$ event-generator results, and that they are in good agreement.


title: Temporal Parameter-free Deep Skinning of Animated Meshes

abstract: In computer graphics, animation compression is essential for efficient storage, streaming and reproduction of animated meshes. Previous work has presented efficient techniques for compression by deriving skinning transformations and weights using clustering of vertices based on geometric features of vertices over time. In this work we present a novel approach that assigns vertices to bone-influenced clusters and derives weights using deep learning through a training set that consists of pairs of vertex trajectories (temporal vertex sequences) and the corresponding weights drawn from fully rigged animated characters. The approximation error of the resulting linear blend skinning scheme is significantly lower than the error of competent previous methods by producing at the same time a minimal number of bones. Furthermore, the optimal set of transformation and vertices is derived in fewer iterations due to the better initial positioning in the multidimensional variable space. Our method requires no parameters to be determined or tuned by the user during the entire process of compressing a mesh animation sequence.


title: Adding Uncertainty to Neural Network Regression Tasks in the Geosciences

abstract: A simple method for adding uncertainty to neural network regression tasks via estimation of a general probability distribution is described. The methodology supports estimation of heteroscedastic, asymmetric uncertainties by a simple modification of the network output and loss function. Method performance is demonstrated with a simple one dimensional data set and then applied to a more complex regression task using synthetic climate data.


title: Towards a new approach of continuous process improvement based on CMMI and PMBOK

abstract: A process-centric approach helps an organization to improve the way it works with. It allows scalability and provides a way to capitalize knowledge on best practices. It also makes better use of resources and helps to understand trends. PMBOK is a project management methodology, while CMMI is a model for process improvement. In this paper, we conduct a study on PMBOK and CMMI frameworks to show that they can be converged and complementary. We expect this paper research will be useful for organizations to deploy a new approach of continuous process improvement based on pooling CMMI and PMBOK.


title: Modeling Ice Friction for Vehicle Dynamics of a Bobsled with Application in Driver Evaluation and Driving Simulation

abstract: We provide an ice friction model for vehicle dynamics of a two-man bobsled which can be used for driver evaluation and in a driver-in-the-loop simulator. Longitudinal friction is modeled by combining experimental results with finite element simulations to yield a correlation between contact pressure and friction. To model lateral friction, we collect data from 44 bobsleigh runs using special sensors. Non-linear regression is used to fit a bob-specific one-track vehicle dynamics model to the data. It is applied in driving simulation and enables a novel method for bob driver evaluation. Bob drivers with various levels of experience are investigated. It shows that a similar performance of the top drivers results from different driving styles.


title: Integrating Sensing and Communication in Cellular Networks via NR Sidelink

abstract: RF-sensing, the analysis and interpretation of movement or environment-induced patterns in received electromagnetic signals, has been actively investigated for more than a decade. Since electromagnetic signals, through cellular communication systems, are omnipresent, RF sensing has the potential to become a universal sensing mechanism with applications in smart home, retail, localization, gesture recognition, intrusion detection, etc. Specifically, existing cellular network installations might be dual-used for both communication and sensing. Such communications and sensing convergence is envisioned for future communication networks. We propose the use of NR-sidelink direct device-to-device communication to achieve device-initiated,flexible sensing capabilities in beyond 5G cellular communication systems. In this article, we specifically investigate a common issue related to sidelink-based RF-sensing, which is its angle and rotation dependence. In particular, we discuss transformations of mmWave point-cloud data which achieve rotational invariance, as well as distributed processing based on such rotational invariant inputs, at angle and distance diverse devices. To process the distributed data, we propose a graph based encoder to capture spatio-temporal features of the data and propose four approaches for multi-angle learning. The approaches are compared on a newly recorded and openly available dataset comprising 15 subjects, performing 21 gestures which are recorded from 8 angles.


title: Energy spectrum of semimetallic HgTe quantum wells

abstract: Quantum wells (QWs) based on mercury telluride (HgTe) thin films provide a large scale of unusual physical properties starting from an insulator via a two-dimensional Dirac semimetal to a three-dimensional topological insulator. These properties result from the dramatic change of the QW band structure with the HgTe film thickness. Although being a key property, these energy dispersion relations cannot be reflected in experiments due to the lack of appropriate tools. Here we report an experimental and theoretical study of two HgTe quantum wells with inverted energy spectrum in which two-dimensional semimetallic states are realized. Using magneto-optical spectroscopy at sub-THz frequencies we were able to obtain information about electron and hole cyclotron masses at all relevant Fermi level positions and different charge densities. The outcome is also supported by a Shubnikov-de Haas analysis of capacitance measurements, which allows obtaining information about the degeneracy of the active modes. From these data, it is possible to reconstruct electron and hole dispersion relations. Detailed comparative analysis of the energy dispersion relations with theoretical calculations demonstrates a good agreement, reflecting even several subtle features like band splitting, the second conduction band, and the overlaps between the first conduction and first valence band. Our study demonstrates that the cyclotron resonance experiments can be efficiently used to directly obtain the band structures of semimetallic 2D materials.


title: Learning What Others Know

abstract: We propose a number of powerful dynamic-epistemic logics for multi-agent information sharing and acts of publicly or privately accessing other agents' information databases. The static base of our logics is obtained by adding to standard epistemic logic comparative epistemic assertions, that can express epistemic superiority between groups or individuals, as well as a common distributed knowledge operator (that combines features of both common knowledge and distributed knowledge). On the dynamic side, we introduce actions by which epistemic superiority can be acquired: "sharing all one knows" (by e.g. giving access to one's information database to all or some of the other agents), as well as more complex informational events, such as hacking. We completely axiomatize several such logics and prove their decidability.


title: Observation of unconventional spin polarization induced spin orbit torque in L1$_2$-ordered antiferromagnetic Mn$_3$Pt thin films

abstract: Non-collinear antiferromagnets exhibits richer magneto-transport properties due to the topologically nontrivial spin structure they possess compared to conventional nonmagnetic materials, which allows us to manipulate the charge-spin conversion more freely by taking advantage of the chirality. In this work, we explore the unconventional spin orbit torque of L1$_2$-ordered Mn$_3$Pt with a triangular spin structure. We observed an unconventional spin orbit torque along the $\mathbf{x}$-direction for the (001)-oriented L1$_2$ Mn$_3$Pt, and found that it has a unique sign reversal behavior relative to the crystalline orientation. This generation of unconventional spin orbit torque for L1$_2$-ordered Mn$_3$Pt can be interpreted as stemming from the magnetic spin Hall effect. This report help clarify the correlation between the topologically nontrivial spin structure and charge-spin conversion in non-collinear antiferromagnets.


title: Skinner-Rusk formalism for k-contact systems

abstract: In previous papers, a geometric framework has been developed to describe non-conservative field theories as a kind of modified Lagrangian and Hamiltonian field theories. This approach is that of $k$-contact Hamiltonian systems, which is based on the $k$-symplectic formulation of field theories as well as on contact geometry. In this work we present the Skinner--Rusk unified setting for these kinds of theories, which encompasses both the Lagrangian and Hamiltonian formalisms into a single picture. This unified framework is specially useful when dealing with singular systems, since: (i) it incorporates in a natural way the second-order condition for the solutions of field equations, (ii) it allows to implement the Lagrangian and Hamiltonian constraint algorithms in a unique simple way, and (iii) it gives the Legendre transformation, so that the Lagrangian and the Hamiltonian formalisms are obtained straightforwardly. We apply this description to several interesting physical examples: the damped vibrating string, the telegrapher's equations, and Maxwell's equations with dissipation terms.


title: Federated Learning of Molecular Properties with Graph Neural Networks in a Heterogeneous Setting

abstract: Chemistry research has both high material and computational costs to conduct experiments. Institutions thus consider chemical data to be valuable and there have been few efforts to construct large public datasets for machine learning. Another challenge is that different intuitions are interested in different classes of molecules, creating heterogeneous data that cannot be easily joined by conventional distributed training. In this work, we introduce federated heterogeneous molecular learning to address these challenges. Federated learning allows end-users to build a global model collaboratively while keeping the training data distributed over isolated clients. Due to the lack of related research, we first simulate a heterogeneous federated learning benchmark (FedChem) by jointly performing scaffold splitting and latent Dirichlet allocation on existing datasets for heterogeneously distributed client data. Our results on FedChem show that significant learning challenges arise when working with heterogeneous molecules across clients. We then propose a method to alleviate the problem, namely Federated Learning by Instance reweighTing (FLIT(+)). FLIT(+) can align the local training across heterogeneous clients by improving the performance for uncertain samples. Comprehensive experiments conducted on our new benchmark FedChem validate the advantages of this method over other federated learning schemes. FedChem should enable a new type of collaboration for improving AI in chemistry that mitigates concerns about valuable chemical data.


title: Modeling the effects of environmental and perceptual uncertainty using deterministic reinforcement learning dynamics with partial observability

abstract: Assessing the systemic effects of uncertainty that arises from agents' partial observation of the true states of the world is critical for understanding a wide range of scenarios. Yet, previous modeling work on agent learning and decision-making either lacks a systematic way to describe this source of uncertainty or puts the focus on obtaining optimal policies using complex models of the world that would impose an unrealistically high cognitive demand on real agents. In this work we aim to efficiently describe the emergent behavior of biologically plausible and parsimonious learning agents faced with partially observable worlds. Therefore we derive and present deterministic reinforcement learning dynamics where the agents observe the true state of the environment only partially. We showcase the broad applicability of our dynamics across different classes of partially observable agent-environment systems. We find that partial observability creates unintuitive benefits in a number of specific contexts, pointing the way to further research on a general understanding of such effects. For instance, partially observant agents can learn better outcomes faster, in a more stable way and even overcome social dilemmas. Furthermore, our method allows the application of dynamical systems theory to partially observable multiagent leaning. In this regard we find the emergence of catastrophic limit cycles, a critical slowing down of the learning processes between reward regimes and the separation of the learning dynamics into fast and slow directions, all caused by partial observability. Therefore, the presented dynamics have the potential to become a formal, yet practical, lightweight and robust tool for researchers in biology, social science and machine learning to systematically investigate the effects of interacting partially observant agents.

categories: nlin.AO cs.AI cs.LG cs.MA physics.soc-ph


title: Evaluation of Distributed Databases in Hybrid Clouds and Edge Computing: Energy, Bandwidth, and Storage Consumption

abstract: A benchmark study of modern distributed databases is an important source of information to select the right technology for managing data in the cloud-edge paradigms. To make the right decision, it is required to conduct an extensive experimental study on a variety of hardware infrastructures. While most of the state-of-the-art studies have investigated only response time and scalability of distributed databases, focusing on other various metrics (e.g., energy, bandwidth, and storage consumption) is essential to fully understand the resources consumption of the distributed databases. Also, existing studies have explored the response time and scalability of these databases either in private or public cloud. Hence, there is a paucity of investigation into the evaluation of these databases deployed in a hybrid cloud, which is the seamless integration of public and private cloud. To address these research gaps, in this paper, we investigate energy, bandwidth and storage consumption of the most used and common distributed databases. For this purpose, we have evaluated four open-source databases (Cassandra, Mongo, Redis and MySQL) on the hybrid cloud spanning over local OpenStack and Microsoft Azure, and a variety of edge computing nodes including Raspberry Pi, a cluster of Raspberry Pi, and low and high power servers. Our extensive experimental results reveal several helpful insights for the deployment selection of modern distributed databases in edge-cloud environments.


title: Shimura subvarieties via endomorphisms

abstract: We show the existence of two new Shimura subvarieties of $\mathcal{A}_2, \mathcal{A}_3$ generically contained in the Torelli locus. They provide the first examples of Shimura subvarieties obtained by means of Jacobians carrying non-trivial endomorphisms not directly induced by the automorphisms of the curves. We also obtain a new example of a Shimura subvariety of $\mathcal{A}_4$ generically contained in the Prym locus.


title: Linear-Time Contact and Friction Dynamics in Maximal Coordinates using Variational Integrators

abstract: Simulation of contact and friction dynamics is an important basis for control- and learning-based algorithms. However, the numerical difficulties of contact interactions pose a challenge for robust and efficient simulators. A maximal-coordinate representation of the dynamics enables efficient solving algorithms, but current methods in maximal coordinates require constraint stabilization schemes. Therefore, we propose an interior-point algorithm for the numerically robust treatment of rigid-body dynamics with contact interactions in maximal coordinates. Additionally, we discretize the dynamics with a variational integrator to prevent constraint drift. Our algorithm achieves linear-time complexity both in the number of contact points and the number of bodies, which is shown theoretically and demonstrated with an implementation. Furthermore, we simulate two robotic systems to highlight the applicability of the proposed algorithm.


title: End-to-End Learning of Flowchart Grounded Task-Oriented Dialogs

abstract: We propose a novel problem within end-to-end learning of task-oriented dialogs (TOD), in which the dialog system mimics a troubleshooting agent who helps a user by diagnosing their problem (e.g., car not starting). Such dialogs are grounded in domain-specific flowcharts, which the agent is supposed to follow during the conversation. Our task exposes novel technical challenges for neural TOD, such as grounding an utterance to the flowchart without explicit annotation, referring to additional manual pages when user asks a clarification question, and ability to follow unseen flowcharts at test time. We release a dataset (FloDial) consisting of 2,738 dialogs grounded on 12 different troubleshooting flowcharts. We also design a neural model, FloNet, which uses a retrieval-augmented generation architecture to train the dialog agent. Our experiments find that FloNet can do zero-shot transfer to unseen flowcharts, and sets a strong baseline for future research.


title: Scope resolution of predicted negation cues: A two-step neural network-based approach

abstract: Neural network-based methods are the state of the art in negation scope resolution. However, they often use the unrealistic assumption that cue information is completely accurate. Even if this assumption holds, there remains a dependency on engineered features from state-of-the-art machine learning methods. The current study adopted a two-step negation resolving apporach to assess whether a Bidirectional Long Short-Term Memory-based method can be used for cue detection as well, and how inaccurate cue predictions would affect the scope resolution performance. Results suggest that this method is not suitable for negation detection. Scope resolution performance is most robust against inaccurate information for models with a recurrent layer only, compared to extensions with a Conditional Random Fields layer or a post-processing algorithm. We advocate for more research into the application of deep learning on negation detection and the effect of imperfect information on scope resolution.


title: $\mathrm{BMO}$ $\varepsilon$-regularity results for solutions to Legendre-Hadamard elliptic systems

abstract: We will establish an $\varepsilon$-regularity result for weak solutions to Legendre-Hadamard elliptic systems, under the a-priori assumption that the gradient $\nabla u$ is small in $\mathrm{BMO}.$ Focusing on the case of Euler-Lagrange systems to simplify the exposition, regularity results will be obtained up to the boundary, and global consequences will be explored. Extensions to general quasilinear elliptic systems and higher-order integrands is also discussed.


title: Modelling Major Disease Outbreaks in the 21st Century: A Causal Approach

abstract: Epidemiologists aiming to model the dynamics of global events face a significant challenge in identifying the factors linked with anomalies such as disease outbreaks. In this paper, we present a novel method for identifying the most important development sectors sensitive to disease outbreaks by using global development indicators as markers. We use statistical methods to assess the causative linkages between these indicators and disease outbreaks, as well as to find the most often ranked indicators. We used data imputation techniques in addition to statistical analysis to convert raw real-world data sets into meaningful data for causal inference. The application of various algorithms for the detection of causal linkages between the indicators is the subject of this research. Despite the fact that disparities in governmental policies between countries account for differences in causal linkages, several indicators emerge as important determinants sensitive to disease outbreaks over the world in the 21st Century.


title: JUBILEE: Secure Debt Relief and Forgiveness

abstract: JUBILEE is a securely computed mechanism for debt relief and forgiveness in a frictionless manner without involving trusted third parties, leading to more harmonious debt settlements by incentivising the parties to truthfully reveal their private information. JUBILEE improves over all previous methods: - individually rational, incentive-compatible, truthful/strategy-proof, ex-post efficient, optimal mechanism for debt relief and forgiveness with private information - by the novel introduction of secure computation techniques to debt relief, the "blessing of the debtor" is hereby granted for the first time: debt settlements with higher expected profits and a higher probability of success than without using secure computation A simple and practical implementation is included for "The Secure Spreadsheet". Another implementation is realised using Raziel smart contracts on a blockchain with Pravuil consensus.


title: Equilibrium and Non-equilibrium Gross-Pitaevskii Lattice Dynamics: Interactions, Disorder, and Thermalization

abstract: The interplay of fluctuations, ergodicity, and disorder in many-body interacting systems has been striking attention for half a century, pivoted on two celebrated phenomena: Anderson localization predicted in disordered media, and Fermi-Pasta-Ulam-Tsingou (FPUT) recurrence observed in a nonlinear system. The destruction of Anderson localization by nonlinearity and the recovery of ergodicity after long enough computational times lead to more questions. This thesis is devoted to contributing to the insight of the nonlinear system dynamics in and out of equilibrium. Focusing mainly on the GP lattice, we investigated elementary fluctuations close to zero temperature, localization properties, the chaotic subdiffusive regimes, and the non-equipartition of energy in non-Gibbs regime. Initially, we probe equilibrium dynamics in the ordered GP lattice and report a weakly non-ergodic dynamics, and an ergodic part in the non-Gibbs phase that implies the Gibbs distribution should be modified. Next, we include disorder in GP lattice, and build analytical expressions for the thermodynamic properties of the ground state, and identify a Lifshits glass regime where disorder dominates over the interactions. In the opposite strong interaction regime, we investigate the elementary excitations above the ground state and found a dramatic increase of the localization length of Bogoliubov modes (BM) with increasing particle density. Finally, we study non-equilibrium dynamics with disordered GP lattice by performing novel energy and norm density resolved wave packet spreading. In particular, we observed strong chaos spreading over several decades, and identified a Lifshits phase which shows a significant slowing down of sub-diffusive spreading.

categories: cond-mat.stat-mech cond-mat.dis-nn nlin.CD physics.comp-ph


title: Random Sampling Plus Fake Data: Multidimensional Frequency Estimates With Local Differential Privacy

abstract: With local differential privacy (LDP), users can privatize their data and thus guarantee privacy properties before transmitting it to the server (a.k.a. the aggregator). One primary objective of LDP is frequency (or histogram) estimation, in which the aggregator estimates the number of users for each possible value. In practice, when a study with rich content on a population is desired, the interest is in the multiple attributes of the population, that is to say, in multidimensional data ($d \geq 2$). However, contrary to the problem of frequency estimation of a single attribute (the majority of the works), the multidimensional aspect imposes to pay particular attention to the privacy budget. This one can indeed grow extremely quickly due to the composition theorem. To the authors' knowledge, two solutions seem to stand out for this task: 1) splitting the privacy budget for each attribute, i.e., send each value with $\frac{\epsilon}{d}$-LDP (Spl), and 2) random sampling a single attribute and spend all the privacy budget to send it with $\epsilon$-LDP (Smp). Although Smp adds additional sampling error, it has proven to provide higher data utility than the former Spl solution. However, we argue that aggregators (who are also seen as attackers) are aware of the sampled attribute and its LDP value, which is protected by a "less strict" $e^{\epsilon}$ probability bound (rather than $e^{\epsilon/d}$). This way, we propose a solution named Random Sampling plus Fake Data (RS+FD), which allows creating uncertainty over the sampled attribute by generating fake data for each non-sampled attribute; RS+FD further benefits from amplification by sampling. We theoretically and experimentally validate our proposed solution on both synthetic and real-world datasets to show that RS+FD achieves nearly the same or better utility than the state-of-the-art Smp solution.


title: Distract Your Attention: Multi-head Cross Attention Network for Facial Expression Recognition

abstract: We present a novel facial expression recognition network, called Distract your Attention Network (DAN). Our method is based on two key observations. Firstly, multiple classes share inherently similar underlying facial appearance, and their differences could be subtle. Secondly, facial expressions exhibit themselves through multiple facial regions simultaneously, and the recognition requires a holistic approach by encoding high-order interactions among local features. To address these issues, we propose our DAN with three key components: Feature Clustering Network (FCN), Multi-head cross Attention Network (MAN), and Attention Fusion Network (AFN). The FCN extracts robust features by adopting a large-margin learning objective to maximize class separability. In addition, the MAN instantiates a number of attention heads to simultaneously attend to multiple facial areas and build attention maps on these regions. Further, the AFN distracts these attentions to multiple locations before fusing the attention maps to a comprehensive one. Extensive experiments on three public datasets (including AffectNet, RAF-DB, and SFEW 2.0) verified that the proposed method consistently achieves state-of-the-art facial expression recognition performance. Code will be made available at https://github.com/yaoing/DAN.


title: Electronic Impurity Scattering Induced Spin Accumulation in Metallic Thin Films

abstract: In order to explore the spin accumulation, evaluating the spin galvanic and spin Hall effect, we utilize the semi-classical Boltzmann equation based on input from the relativistic Korringa-Kohn-Rostoker Green's function method, within the density functional theory. We calculate the spin accumulation including multiple contributions, especially skew-scattering (scattering-in term) and compare this to three different approximations, which include the isotropic and anisotropic relaxation time approximation. For heavy metals, with strong intrinsic spin-orbit coupling, we find that almost all the effects are captured within the anisotropic relaxation time approximation. On the other hand, in light metals the contributions from the vertex corrections (scattering-in term) are comparable to the induced effect in anisotropic relaxation time approximation. We put a particular focus on the influence of the atomic character of the substitutional impurities on the spin accumulation as well as the dependence on the impurity position. As impurities will break space inversion symmetry of the thin film, this will give rise to both symmetric and antisymmetric contributions to the spin accumulation. In general, we find the impurities at the surface generate the largest efficiency of charge-to-spin conversion in case of the spin accumulation. Comparing our results to existing experimental findings for Pt we find a good agreement.


title: High-resolution neural network-driven mapping of multiple diffusion metrics leveraging asymmetries in the balanced SSFP frequency profile

abstract: We suggest to utilize the rich information content about microstructural tissue properties entangled in asymmetric balanced steady-state free precession (bSSFP) profiles to estimate multiple diffusion metrics simultaneously by neural network (NN) parameter quantification. A 12-point bSSFP phase-cycling scheme with high-resolution whole-brain coverage is employed at 3 T and 9.4 T for NN input. Low-resolution target diffusion data are derived based on diffusion-weighted spin-echo echo-planar-imaging (SE-EPI) scans, i.e., mean, axial, and radial diffusivity (MD, AD, RD), fractional anisotropy (FA) as well as the spherical coordinates (azimuth ${\Phi}$ and inclination ${\Theta}$) of the principal diffusion eigenvector. A feedforward NN is trained with incorporated probabilistic uncertainty estimation. The NN predictions yielded highly reliable results in white matter (WM) and gray matter (GM) structures for MD. The quantification of FA, AD, and RD was overall in good agreement with the reference but the dependence of these parameters on WM anisotropy was somewhat biased, e.g., in corpus callosum. The inclination ${\Theta}$ was well predicted for anisotropic WM structures while the azimuth ${\Phi}$ was overall poorly predicted. The findings were highly consistent across both field strengths. Application of the optimized NN to high-resolution input data provided whole-brain maps with rich structural details. In conclusion, the proposed NN-driven approach showed potential to provide distortion-free high-resolution whole-brain maps of multiple diffusion metrics at high to ultra-high field strengths in clinically relevant scan times.


title: NBcoded: network attack classifiers based on Encoder and Naive Bayes model for resource limited devices

abstract: In the recent years, cybersecurity has gained high relevance, converting the detection of attacks or intrusions into a key task. In fact, a small breach in a system, application, or network, can cause huge damage for the companies. However, when this attack detection encounters the Artificial Intelligence paradigm, it can be addressed using high-quality classifiers which often need high resource demands in terms of computation or memory usage. This situation has a high impact when the attack classifiers need to be used with limited resourced devices or without overloading the performance of the devices, as it happens for example in IoT devices, or in industrial systems. For overcoming this issue, NBcoded, a novel light attack classification tool is proposed in this work. NBcoded works in a pipeline combining the removal of noisy data properties of the encoders with the low resources and timing consuming obtained by the Naive Bayes classifier. This work compares three different NBcoded implementations based on three different Naive Bayes likelihood distribution assumptions (Gaussian, Complement and Bernoulli). Then, the best NBcoded is compared with state of the art classifiers like Multilayer Perceptron and Random Forest. Our implementation shows to be the best model reducing the impact of training time and disk usage, even if it is outperformed by the other two in terms of Accuracy and F1-score (~ 2%).


title: Binaural rendering from microphone array signals of arbitrary geometry

abstract: A method of binaural rendering from microphone array signals of arbitrary geometry is proposed. To reproduce binaural signals from microphone array recordings at a remote location, a spherical microphone array is generally used for capturing a soundfield. However, owing to the lack of flexibility in the microphone arrangement, the single spherical array is sometimes impractical for estimating a large region of a soundfield. We propose a method based on harmonic analysis of infinite order, which allows the use of arbitrarily placed microphones. In the synthesis of the estimated soundfield, a spherical-wave-decomposition-based binaural rendering is also formulated to take into consideration the distance in measuring head-related transfer functions. We develop and evaluate a composite microphone array consisting of multiple small arrays. Experimental results including those of listening tests indicate that our proposed method is robust against change in listening position in the recording area.


title: DROMO: Distributionally Robust Offline Model-based Policy Optimization

abstract: We consider the problem of offline reinforcement learning with model-based control, whose goal is to learn a dynamics model from the experience replay and obtain a pessimism-oriented agent under the learned model. Current model-based constraint includes explicit uncertainty penalty and implicit conservative regularization that pushes Q-values of out-of-distribution state-action pairs down and the in-distribution up. While the uncertainty estimation, on which the former relies on, can be loosely calibrated for complex dynamics, the latter performs slightly better. To extend the basic idea of regularization without uncertainty quantification, we propose distributionally robust offline model-based policy optimization (DROMO), which leverages the ideas in distributionally robust optimization to penalize a broader range of out-of-distribution state-action pairs beyond the standard empirical out-of-distribution Q-value minimization. We theoretically show that our method optimizes a lower bound on the ground-truth policy evaluation, and it can be incorporated into any existing policy gradient algorithms. We also analyze the theoretical properties of DROMO's linear and non-linear instantiations.


title: Sequence Length is a Domain: Length-based Overfitting in Transformer Models

abstract: Transformer-based sequence-to-sequence architectures, while achieving state-of-the-art results on a large number of NLP tasks, can still suffer from overfitting during training. In practice, this is usually countered either by applying regularization methods (e.g. dropout, L2-regularization) or by providing huge amounts of training data. Additionally, Transformer and other architectures are known to struggle when generating very long sequences. For example, in machine translation, the neural-based systems perform worse on very long sequences when compared to the preceding phrase-based translation approaches (Koehn and Knowles, 2017). We present results which suggest that the issue might also be in the mismatch between the length distributions of the training and validation data combined with the aforementioned tendency of the neural networks to overfit to the training data. We demonstrate on a simple string editing task and a machine translation task that the Transformer model performance drops significantly when facing sequences of length diverging from the length distribution in the training data. Additionally, we show that the observed drop in performance is due to the hypothesis length corresponding to the lengths seen by the model during training rather than the length of the input sequence.


title: Photon detection probability prediction using one-dimensional generative neural network

abstract: Photon detection is important for liquid argon detectors for direct dark matter searches or neutrino property measurements. Precise simulation of photon transport is widely used to understand the probability of photon detection in liquid argon detectors. Traditional photon transport simulation, which tracks every photon using theGeant4simulation toolkit, is a major computational challenge for kilo-tonne-scale liquid argon detectors and GeV-level energy depositions. In this work, we propose a one-dimensional generative model which efficiently generates features using an OuterProduct-layer. This model bypasses photon transport simulation and predicts the number of photons detected by particular photon detectors at the same level of detail as theGeant4simulation. The application to simulating photon detection systems in kilo-tonne-scale liquid argon detectors demonstrates this novel generative model is able to reproduceGeant4simulation with good accuracy and 20 to 50 times faster. This generative model can be used to quickly predict photon detection probability in huge liquid argon detectors like ProtoDUNE or DUNE.


title: Principles of the Battery Data Genome

abstract: Electrochemical energy storage is central to modern society -- from consumer electronics to electrified transportation and the power grid. It is no longer just a convenience but a critical enabler of the transition to a resilient, low-carbon economy. The large pluralistic battery research and development community serving these needs has evolved into diverse specialties spanning materials discovery, battery chemistry, design innovation, scale-up, manufacturing and deployment. Despite the maturity and the impact of battery science and technology, the data and software practices among these disparate groups are far behind the state-of-the-art in other fields (e.g. drug discovery), which have enjoyed significant increases in the rate of innovation. Incremental performance gains and lost research productivity, which are the consequences, retard innovation and societal progress. Examples span every field of battery research , from the slow and iterative nature of materials discovery, to the repeated and time-consuming performance testing of cells and the mitigation of degradation and failures. The fundamental issue is that modern data science methods require large amounts of data and the battery community lacks the requisite scalable, standardized data hubs required for immediate use of these approaches. Lack of uniform data practices is a central barrier to the scale problem. In this perspective we identify the data- and software-sharing gaps and propose the unifying principles and tools needed to build a robust community of data hubs, which provide flexible sharing formats to address diverse needs. The Battery Data Genome is offered as a data-centric initiative that will enable the transformative acceleration of battery science and technology, and will ultimately serve as a catalyst to revolutionize our approach to innovation.