title: Peer Collaborative Learning for Polyphonic Sound Event Detection

abstract: This paper describes that semi-supervised learning called peer collaborative learning (PCL) can be applied to the polyphonic sound event detection (PSED) task, which is one of the tasks in the Detection and Classification of Acoustic Scenes and Events (DCASE) challenge. Many deep learning models have been studied to find out what kind of sound events occur where and for how long in a given audio clip. The characteristic of PCL used in this paper is the combination of ensemble-based knowledge distillation into sub-networks and student-teacher model-based knowledge distillation, which can train a robust PSED model from a small amount of strongly labeled data, weakly labeled data, and a large amount of unlabeled data. We evaluated the proposed PCL model using the DCASE 2019 Task 4 datasets and achieved an F1-score improvement of about 10% compared to the baseline model.


title: Application of DEA in International Market Selection for the export of products from Spain

abstract: This article presents a Benchmarking methodology to support decision-making for international market selection (IMS). In order to do so, we will be using an output-oriented Data Envelopment Analysis (DEA) model. This methodology considers multiple variables validated with a correlation analysis. The methodology is applied to all of the products directly exported from Spain, it takes into consideration different Inputs variables and returns us the efficient and regions generating higher benefits to access international markets with the lowest costs possible.


title: Accelerated Componentwise Gradient Boosting using Efficient Data Representation and Momentum-based Optimization

abstract: Componentwise boosting (CWB), also known as model-based boosting, is a variant of gradient boosting that builds on additive models as base learners to ensure interpretability. CWB is thus often used in research areas where models are employed as tools to explain relationships in data. One downside of CWB is its computational complexity in terms of memory and runtime. In this paper, we propose two techniques to overcome these issues without losing the properties of CWB: feature discretization of numerical features and incorporating Nesterov momentum into functional gradient descent. As the latter can be prone to early overfitting, we also propose a hybrid approach that prevents a possibly diverging gradient descent routine while ensuring faster convergence. We perform extensive benchmarks on multiple simulated and real-world data sets to demonstrate the improvements in runtime and memory consumption while maintaining state-of-the-art estimation and prediction performance.


title: A logico-linguistic inquiry into the foundations of physics: Part I

abstract: Physical dimensions are {\it not numbers}, but used as {\it numbers} to perform dimensional analysis by the physicist. The law of excluded middle falls short of explaining the contradictory meanings of the same symbols. The statements like ``$r\to 0$'', ``$q\to 0$'', used by the physicist, are inconsistent on dimensional grounds because ``$r$'', ``$q$'' represent {\it quantities} with physical dimensions of $[L], [Q]$ respectively and ``$0$'' represents just a number devoid of physical dimension. Consequently, the involvement of the statement ``$\lim_{q\to 0}$, where $q$ is the test charge'' in the definition of electric field leads to either circular reasoning or a contradiction regarding the experimental verification of the smallest charge in the Millikan-Fletcher oil drop experiment. Considering such issues as problematic, by choice, I make an inquiry regarding the basic language in terms of which physics is written, with an aim of exploring how truthfully the verbal statements can be converted to the corresponding physico-mathematical expressions (involving physical dimensions). Necessarily I demonstrate the meaning of the terms ``self inquiry'', ``middle way'', ``dependent origination'', ``emptiness/relational existence'', which signify the basic tenets of Buddhism. In light of this, I explain my view of ``definition''; the relation among quantity, physical dimension and number; the logico-linguistic fallacy of ``zero quantity''; difference between unit and unity. I present a critical analysis of the definitions of electric field due to Maxwell and Jackson. A postulate regarding the existence of charges becomes necessary which, however, resolves the contradiction regarding the oil drop experiment. This work is an appeal for the dissociation of the categorical disciplines of logic and physics and on the large, a fruitful merger of Eastern philosophy and Western science.


title: Use of Deterministic Transforms to Design Weight Matrices of a Neural Network

abstract: Self size-estimating feedforward network (SSFN) is a feedforward multilayer network. For the existing SSFN, a part of each weight matrix is trained using a layer-wise convex optimization approach (a supervised training), while the other part is chosen as a random matrix instance (an unsupervised training). In this article, the use of deterministic transforms instead of random matrix instances for the SSFN weight matrices is explored. The use of deterministic transforms provides a reduction in computational complexity. The use of several deterministic transforms is investigated, such as discrete cosine transform, Hadamard transform, Hartley transform, and wavelet transforms. The choice of a deterministic transform among a set of transforms is made in an unsupervised manner. To this end, two methods based on features' statistical parameters are developed. The proposed methods help to design a neural net where deterministic transforms can vary across its layers' weight matrices. The effectiveness of the proposed approach vis-a-vis the SSFN is illustrated for object classification tasks using several benchmark datasets.


title: Authentication of Smart Grid Communications using Quantum Key Distribution

abstract: Smart grid solutions enable utilities and customers to better monitor and control energy use via information and communications technology. Information technology is intended to improve the future electric grid's reliability, efficiency, and sustainability by implementing advanced monitoring and control systems. However, leveraging modern communications systems also makes the grid vulnerable to cyberattacks. Here we report the first use of quantum key distribution (QKD) keys in the authentication of smart grid communications. In particular, we make such demonstration on a deployed electric utility fiber network. The developed method was prototyped in a software package to manage and utilize cryptographic keys to authenticate machine-to-machine communications used for supervisory control and data acquisition (SCADA). This demonstration showcases the feasibility of using QKD to improve the security of critical infrastructure, including future distributed energy resources (DERs), such as energy storage.


title: Representation of probability distributions with implied volatility and biological rationale

abstract: Economic and financial theories and practice essentially deal with uncertain future. Humans encounter uncertainty in different kinds of activity, from sensory-motor control to dynamics in financial markets, what has been subject of extensive studies. Representation of uncertainty with normal or lognormal distribution is a common feature of many of those studies. For example, proposed Bayessian integration of Gaussian multisensory input in the brain or log-normal distribution of future asset price in renowned Black-Scholes-Merton (BSM) model for pricing contingent claims. Standard deviation of log(future asset price) scaled by square root of time in the BSM model is called implied volatility. Actually, log(future asset price) is not normally distributed and traders account for that to avoid losses. Nevertheless the BSM formula derived under the assumption of constant volatility remains a major uniform framework for pricing options in financial markets. I propose that one of the reasons for such a high popularity of the BSM formula could be its ability to translate uncertainty measured with implied volatility into price in a way that is compatible with human intuition for measuring uncertainty. The present study deals with mathematical relationship between uncertainty and the BSM implied volatility. Examples for a number of common probability distributions are presented. Overall, this work proposes that representation of various probability distributions in terms of the BSM implied volatility profile may be meaningful in both biological and financial worlds. Necessary background from financial mathematics is provided in the text.


title: The Closure of the Physical, Consciousness and Scientific Practice

abstract: We analyse the implications of the closure of the physical for experiments in the scientific study of consciousness when all the details are considered, especially how measurement results relate to physical events. It turns out that the closure of the physical has surprising implications that conflict with scientific practice. These implications point to a fundamental flaw in the paradigm underlying many experiments conducted to date and pose a challenge to any research programme that aims to ground a physical functionalist or identity-based understanding of consciousness on empirical observations.


title: Structural characterization of the interfacial self-assembly of chitosan with oppositely charged surfactant

abstract: Controlling the assembly of polyelectrolytes and surfactant at liquid-liquid interfaces offers new ways to fabricate soft materials with specific physical properties. However, little is known of the relationships between the kinetics of interfacial assembly, structural and rheological properties of such interfaces. We studied the kinetics at water-oil interface of the assembly of a positively charged biopolymer, chitosan, with an anionic fatty acid using a multi-scale approach. The growth kinetics of the membrane was followed by interfacial rheometry and space- and time- resolved dynamic light scattering. This set of techniques revealed that the interfacial complexation was a multi-step process. At short time-scale, the interface was fluid and made of heterogeneous patches. At a 'gelation' time, the surface elastic modulus and the correlation between speckles increased sharply meaning that the patches percolated. Confocal and electron microscopy confirmed this picture, and revealed that the basic brick of the membrane was sub-micrometric aggregates of chitosan / fatty acid.


title: Accent-Robust Automatic Speech Recognition Using Supervised and Unsupervised Wav2vec Embeddings

abstract: Speech recognition models often obtain degraded performance when tested on speech with unseen accents. Domain-adversarial training (DAT) and multi-task learning (MTL) are two common approaches for building accent-robust ASR models. ASR models using accent embeddings is another approach for improving robustness to accents. In this study, we perform systematic comparisons of DAT and MTL approaches using a large volume of English accent corpus (4000 hours of US English speech and 1244 hours of 20 non-US-English accents speech). We explore embeddings trained under supervised and unsupervised settings: a separate embedding matrix trained using accent labels, and embeddings extracted from a fine-tuned wav2vec model. We find that our DAT model trained with supervised embeddings achieves the best performance overall and consistently provides benefits for all testing datasets, and our MTL model trained with wav2vec embeddings are helpful learning accent-invariant features and improving novel/unseen accents. We also illustrate that wav2vec embeddings have more advantages for building accent-robust ASR when no accent labels are available for training supervised embeddings.


title: The missing label of $\mathfrak{su}_3$ and its symmetry

abstract: We present explicit formulas for the operators providing missing labels for the tensor product of two irreducible representations of $\mathfrak{su}_3$. The result is seen as a particular representation of the diagonal centraliser of $\mathfrak{su}_3$ through a pair of tridiagonal matrices. Using these explicit formulas, we investigate the symmetry of this missing label problem and we find a symmetry group of order 144 larger than what can be expected from the natural symmetries. Several realisations of this symmetry group are given, including an interpretation as a subgroup of the Weyl group of type $E_6$, which appeared in an earlier work as the symmetry group of the diagonal centraliser. Using the combinatorics of the root system of type $E_6$, we provide a family of representations of the diagonal centraliser by infinite tridiagonal matrices, from which all the finite-dimensional representations affording the missing label can be extracted. Besides, some connections with the Hahn algebra, Heun--Hahn operators and Bethe ansatz are discussed along with some similarities with the well-known symmetries of the Clebsch--Gordan coefficients.


title: Surrogate-Based Black-Box Optimization Method for Costly Molecular Properties

abstract: AI-assisted molecular optimization is a very active research field as it is expected to provide the next-generation drugs and molecular materials. An important difficulty is that the properties to be optimized rely on costly evaluations. Machine learning methods are investigated with success to predict these properties, but show generalization issues on less known areas of the chemical space. We propose here a surrogate-based black box optimization method, to tackle jointly the optimization and machine learning problems. It consists in optimizing the expected improvement of the surrogate of a molecular property using an evolutionary algorithm. The surrogate is defined as a Gaussian Process Regression (GPR) model, learned on a relevant area of the search space with respect to the property to be optimized. We show that our approach can successfully optimize a costly property of interest much faster than a purely metaheuristic approach.


title: Range and Bearing Data Fusion for Precise Convex Network Localization

abstract: Hybrid localization in GNSS-challenged environments using measured ranges and angles is becoming increasingly popular, in particular with the advent of multimodal communication systems. Here, we address the hybrid network localization problem using ranges and bearings to jointly determine the positions of a number of agents through a single maximum-likelihood (ML) optimization problem that seamlessly fuses all the available pairwise range and angle measurements. We propose a tight convex surrogate to the ML estimator, we examine practical measures for the accuracy of the relaxation, and we comprehensively characterize its behavior in simulation. We found that our relaxation outperforms a state of the art SDP relaxation by one order of magnitude in terms of localization error, and is amenable to much more lightweight solution algorithms.


title: Data-Driven Methods for Balancing Fairness and Efficiency in Ride-Pooling

abstract: Rideshare and ride-pooling platforms use artificial intelligence-based matching algorithms to pair riders and drivers. However, these platforms can induce inequality either through an unequal income distribution or disparate treatment of riders. We investigate two methods to reduce forms of inequality in ride-pooling platforms: (1) incorporating fairness constraints into the objective function and (2) redistributing income to drivers to reduce income fluctuation and inequality. To evaluate our solutions, we use the New York City taxi data set. For the first method, we find that optimizing for driver-side fairness outperforms state-of-the-art models on the number of riders serviced, both in the worst-off neighborhood and overall, showing that optimizing for fairness can assist profitability in certain circumstances. For the second method, we explore income redistribution as a way to combat income inequality by having drivers keep an $r$ fraction of their income, and contributing the rest to a redistribution pool. For certain values of $r$, most drivers earn near their Shapley value, while still incentivizing drivers to maximize value, thereby avoiding the free-rider problem and reducing income variability. The first method can be extended to many definitions of fairness and the second method provably improves fairness without affecting profitability.


title: Rotating black holes and exotic compact objects in the Kerr/CFT correspondence within Rastall gravity

abstract: Quantum gravitational effects on the near horizon may alter the black hole's horizon drastically to be partially reflective, portrayed by a quantum membrane. With this modification, the object can be considered as an exotic compact object (ECO). Quantum effects on the strong gravitational regime may also lead to a non-conserved matter tensor that can be described phenomenologically using Rastall gravity. In this work, we study the properties of black holes and ECOs within Rastall gravity using Kerr/CFT correspondence. We systematically investigate the properties of the most general rotating black hole solutions in Rastall gravity, i.e., Kerr-Newman-NUT-Kiselev, and reveal its hidden conformal symmetry. The Cardy microscopic entropy formula and absorption cross-sections from 2D CFT are computed and then matched with gravity calculation. We also extend the dual CFT analysis for studying the properties of ECOs. The existence of the quantum membrane leads to the appearance of the gravitational echoes that is manifested as an oscillatory feature on the absorption cross-section. We compute the absorption cross-section and quasi-normal modes in the dual CFT picture. We also compare the absorption cross-section of ECOs to that of black holes. We find that the Rastall coupling constant plays a significant role for both objects. We also obtain that the echo time delay depends explicitly on the Rastall coupling constant. This coupling constant may play a role to recover the correction on time delay that is believed as a non-linear physics effect. Henceforth, the signature of the Rastall gravity can be probed from the time-delay observation.


title: Tissue Engineering of Skin Regeneration and Hair Growth

abstract: Many people suffering from skin disorders such as chronic wounds, non-healing ulcers, and diabetic ulcers need skin repair and regeneration. Aside from the diseases listed above, the industry needed a skin rejuvenation system and regeneration for cosmetic purposes. The procedure used to deliver pluripotent stem cells to the desired tissue was known as reconstructive medicine. Mesenchymal stem cells are the most fascinating since, when put in the correct setting and stimulated with the proper growth factors, they could choose a pathway to differentiate into the desired tissue. They are also very available, inexpensive, simple to extract, and reproducible. These mesenchymal stem cells are derived from bone marrow, bone, connective tissues, fats, and other tissues. Fat is the ideal reservoir for mesenchymal cells that have recently been identified. Fibrous, collagen fibers and fibroblasts create fat.


title: Isotropic dynamical black holes

abstract: A new type of dynamical black holes is defined in manifolds with flat space sections having the asymptotic behaviour of spatially flat Friedmann-Lema\^ itre-Robertson-Walker (FLRW) space-times. These black holes are no longer vacuum solutions of the Einstein equations but preserve the isotropy of the flat space sections of the asymptotic FLRW manifolds.


title: Decoding ECoG signal into 3D hand translation using deep learning

abstract: Motor brain-computer interfaces (BCIs) are a promising technology that may enable motor-impaired people to interact with their environment. Designing real-time and accurate BCI is crucial to make such devices useful, safe, and easy to use by patients in a real-life environment. Electrocorticography (ECoG)-based BCIs emerge as a good compromise between invasiveness of the recording device and good spatial and temporal resolution of the recorded signal. However, most ECoG signal decoders used to predict continuous hand movements are linear models. These models have a limited representational capacity and may fail to capture the relationship between ECoG signal and continuous hand movements. Deep learning (DL) models, which are state-of-the-art in many problems, could be a solution to better capture this relationship. In this study, we tested several DL-based architectures to predict imagined 3D continuous hand translation using time-frequency features extracted from ECoG signals. The dataset used in the analysis is a part of a long-term clinical trial (ClinicalTrials.gov identifier: NCT02550522) and was acquired during a closed-loop experiment with a tetraplegic subject. The proposed architectures include multilayer perceptron (MLP), convolutional neural networks (CNN), and long short-term memory networks (LSTM). The accuracy of the DL-based and multilinear models was compared offline using cosine similarity. Our results show that CNN-based architectures outperform the current state-of-the-art multilinear model. The best architecture exploited the spatial correlation between neighboring electrodes with CNN and benefited from the sequential character of the desired hand trajectory by using LSTMs. Overall, DL increased the average cosine similarity, compared to the multilinear model, by up to 60%, from 0.189 to 0.302 and from 0.157 to 0.249 for the left and right hand, respectively.


title: Using Single-Trial Representational Similarity Analysis with EEG to track semantic similarity in emotional word processing

abstract: Electroencephalography (EEG) is a powerful non-invasive brain imaging technique with a high temporal resolution that has seen extensive use across multiple areas of cognitive science research. This thesis adapts representational similarity analysis (RSA) to single-trial EEG datasets and introduces its principles to EEG researchers unfamiliar with multivariate analyses. We have two separate aims: 1. we want to explore the effectiveness of single-trial RSA on EEG datasets; 2. we want to utilize single-trial RSA and computational semantic models to investigate the role of semantic meaning in emotional word processing. We report two primary findings: 1. single-trial RSA on EEG datasets can produce meaningful and interpretable results given a high number of trials and subjects; 2. single-trial RSA reveals that emotional processing in the 500-800ms time window is associated with additional semantic analysis.


title: The lack of vacuum polarization in quantum electrodynamics with spinors in fermion equations

abstract: In this paper, the versions of quantum electrodynamics (QED) with spinors in fermion equations are briefly examined. In the new variants of the theory, the concept of vacuum polarization is unnecessary. The new content of fermion vacuum (without the Dirac sea) in the examined versions of QED leads to new physical consequences, part of which can be tested experimentally in the future.


title: Bouncing and coasting universe with exact quantum-classical correspondence

abstract: When the scale factor of expansion of the universe is written as $ a(t)\equiv Ae^{\alpha(t)}$, with $A$ as some real constant and $\alpha(t)$ a real function, the gravitational action $I_G$ appears in the same form as the matter action $I_M$ for a homogeneous and isotropic scalar field with a specific scale factor-dependent potential. We observe that by making analytic continuation of the Lagrangian function in this $I_G$ to the complex plane of $\alpha$, one can obtain terms corresponding to both parts of a total action that describes a viable cosmological model. The solution gives a bouncing and coasting universe, which first contracts and then expands linearly, with a smooth bounce in between them. Such a bounce, called a Tolman wormhole, is due to a Casimir-like negative energy that appears naturally in the solution. In a novel approach to quantum cosmology, we perform canonical quantization of the above model using the operator method and show that it can circumvent the operator ordering ambiguity in the conventional formalism. It leads to a quantum wave equation for the universe, solving which we get the interesting result that the universe is in a ground state with nonzero energy. This solution is different from the Wheeler-DeWitt wave function and possesses exact quantum-classical correspondence during all epochs.


title: A critical lattice model for a Haagerup conformal field theory

abstract: We use the formalism of strange correlators to construct a critical classical lattice model in two dimensions with the \emph{Haagerup fusion category} $\mathcal{H}_3$ as input data. We present compelling numerical evidence in the form of finite entanglement scaling to support a Haagerup conformal field theory (CFT) with central charge $c=2$. Generalized twisted CFT spectra are numerically obtained through exact diagonalization of the transfer matrix and the conformal towers are separated in the spectra through their identification with the topological sectors. It is further argued that our model can be obtained through an orbifold procedure from a larger lattice model with input $Z(\mathcal{H}_3)$, which is the simplest modular tensor category that does not admit an algebraic construction. This provides a counterexample for the conjecture that all rational CFT can be constructed from standard methods.

categories: cond-mat.stat-mech hep-th math-ph math.MP quant-ph


title: NoLiTiA: An Open-Source Toolbox for Nonlinear Time Series Analysis

abstract: In many scientific fields like e.g. neuroscience, climatology or physics, complex relationships can be described most parsimoniously by nonlinear mechanics. Despite their relevance, many scientists still apply linear estimates in order to evaluate complex interactions. This is partially due to the lack of a comprehensive compilation of nonlinear methods. Available packages mostly specialize in only one aspect of nonlinear time-series analysis and most often require some coding proficiency to use. Here, we introduce NoLiTiA, a free open-source MATLAB toolbox for nonlinear time series analysis. In comparison to other currently available nonlinear packages, NoLiTiA offers 1) an implementation of a broad range of classic and recently developed methods, 2) an implementation of newly proposed spatially and time-resolved recurrence analysis and 3) an intuitive environment accessible even to users with little coding experience due to a graphical user interface and batch-editor. The core methodology derives from three distinct fields of complex systems theory, including dynamical systems theory, recurrence quantification analysis and information theory. Besides established methodology including estimation of dynamic invariants like Lyapunov exponents and entropy-based measures, such as active information storage, we include recent developments of quantifying time-resolved aperiodic oscillations. In general, the toolbox will make nonlinear methods accessible to the broad scientific community engaged in time series processing.


title: An Accurate Smartphone Battery Parameter Calibration Using Unscented Kalman Filter

abstract: Internet of Things (IoT) applications have opened up numerous possibilities to improve our lives. Most of the remote devices, part of the IoT network, such as smartphones, data loggers and wireless sensors are battery powered. It is vital to collect battery measurement data (Voltage or State-of-Charge (SOC)) from these remote devices. Presence of noise in these measurements restricts effective utilization of this dataset. This paper presents the application of Unscented Kalman Filter (UKF) to mitigate measurement noise in smartphone dataset. The simplicity of this technique makes it a constructive approach for noise removal. The datasets obtained after noise removal could be used to improve data-driven time series forecasting models which aid to accurately estimate critical battery parameters such as SOC. UKF was tested on noisy charge and discharge dataset of a smartphone. An overall Mean Squared Error (MSE) of 0.0017 and 0.0010 was obtained for Voltage charge and discharge measurements. MSE for SOC charge and discharge data measurements were 0.0018 and 0.0010 respectively.


title: A Few-shot Learning Graph Multi-Trajectory Evolution Network for Forecasting Multimodal Baby Connectivity Development from a Baseline Timepoint

abstract: Charting the baby connectome evolution trajectory during the first year after birth plays a vital role in understanding dynamic connectivity development of baby brains. Such analysis requires acquisition of longitudinal connectomic datasets. However, both neonatal and postnatal scans are rarely acquired due to various difficulties. A small body of works has focused on predicting baby brain evolution trajectory from a neonatal brain connectome derived from a single modality. Although promising, large training datasets are essential to boost model learning and to generalize to a multi-trajectory prediction from different modalities (i.e., functional and morphological connectomes). Here, we unprecedentedly explore the question: Can we design a few-shot learning-based framework for predicting brain graph trajectories across different modalities? To this aim, we propose a Graph Multi-Trajectory Evolution Network (GmTE-Net), which adopts a teacher-student paradigm where the teacher network learns on pure neonatal brain graphs and the student network learns on simulated brain graphs given a set of different timepoints. To the best of our knowledge, this is the first teacher-student architecture tailored for brain graph multi-trajectory growth prediction that is based on few-shot learning and generalized to graph neural networks (GNNs). To boost the performance of the student network, we introduce a local topology-aware distillation loss that forces the predicted graph topology of the student network to be consistent with the teacher network. Experimental results demonstrate substantial performance gains over benchmark methods. Hence, our GmTE-Net can be leveraged to predict atypical brain connectivity trajectory evolution across various modalities. Our code is available at https: //github.com/basiralab/GmTE-Net.


title: Prototype Learning for Interpretable Respiratory Sound Analysis

abstract: Remote screening of respiratory diseases has been widely studied as a non-invasive and early instrument for diagnosis purposes, especially in the pandemic. The respiratory sound classification task has been realized with numerous deep neural network (DNN) models due to their superior performance. However, in the high-stake medical domain where decisions can have significant consequences, it is desirable to develop interpretable models; thus, providing understandable reasons for physicians and patients. To address the issue, we propose a prototype learning framework, that jointly generates exemplar samples for explanation and integrates these samples into a layer of DNNs. The experimental results indicate that our method outperforms the state-of-the-art approaches on the largest public respiratory sound database.


title: A Sidelink-Aided Approach for Secure Multicast Service Delivery: from Human-Oriented Multimedia Traffic to Machine Type Communications

abstract: To date, group-oriented communications have been mainly exploited for delivering multimedia services in human-oriented communications while, in future fifth generation (5G) cellular networks, objects will be the main target. Internet of Things (IoT) will undoubtedly play a key role in 5G networks, wherein massive machine-type communications (mMTC) feature a use case as crucial as challenging since cellular IoT connections are predicted to grow heavily in the next future. To boost capacity and energy efficiency, the 5G network can leverage device-to-device (D2D) communications which are recognized as an effective offloading technique. This is achieved thanks to the fact that, in legacy D2D communications, data are directly sent from one device to another, avoiding the crossing of the network. Obviously, the distributed nature of such a communication paradigm and the inherent broadcast nature of the wireless channel make it necessary to think how to secure the so called "sidelink" transmissions. This work proposes a protocol for the efficient and reliable management of multicast services in a 5G-oriented IoT scenario, in which security is a crucial requirement to be met. The proposed protocol is tailored to Narrowband IoT (NB-IoT) and makes use of D2D communications with the aim of improving network efficiency and optimizing network resource utilization. In addition, cyber security and social trustworthiness mechanisms are exploited to secure D2D communications.


title: Three problems in convergence theory

abstract: In this note it is proved that the class of paratopologies is simple and that under the assumption that the measurable cardinals form a proper class, the class of hypotopologies is not simple. Moreover, an example is given of a Hausdorff convergence with idempotent set adherence (subdiagonal convergence) that is not weakly diagonal.


title: Magnetic Frustration in a Zeolite

abstract: Zeolites are so well known in real world applications and after decades of scientific study that they hardly need any intro-duction: their importance in chemistry cannot be overemphasized. Here we add to the remarkable properties that they dis-play by reporting our discovery that the simplest zeolite, sodalite, when doped with Cr3+ in the \b{eta}-cage, is a frustrated magnet. Soft X-ray absorption spectroscopy and magnetic measurements reveal that the Cr present is Cr(III). Cr(III), with its isotropic 3d3 valence electron configuration, is well-known as the basis for many geometrically frustrated magnets, but it is especially surprising that a material like the Ca8Al12Cr2O29 zeolite is a frustrated magnet. This finding illustrates the value of exploring the properties of even well-known materials families.


title: A Broad Ensemble Learning System for Drifting Stream Classification

abstract: In a data stream environment, classification models must handle concept drift efficiently and effectively. Ensemble methods are widely used for this purpose; however, the ones available in the literature either use a large data chunk to update the model or learn the data one by one. In the former, the model may miss the changes in the data distribution, and in the latter, the model may suffer from inefficiency and instability. To address these issues, we introduce a novel ensemble approach based on the Broad Learning System (BLS), where mini chunks are used at each update. BLS is an effective lightweight neural architecture recently developed for incremental learning. Although it is fast, it requires huge data chunks for effective updates, and is unable to handle dynamic changes observed in data streams. Our proposed approach named Broad Ensemble Learning System (BELS) uses a novel updating method that significantly improves best-in-class model accuracy. It employs an ensemble of output layers to address the limitations of BLS and handle drifts. Our model tracks the changes in the accuracy of the ensemble components and react to these changes. We present the mathematical derivation of BELS, perform comprehensive experiments with 20 datasets that demonstrate the adaptability of our model to various drift types, and provide hyperparameter and ablation analysis of our proposed model. Our experiments show that the proposed approach outperforms nine state-of-the-art baselines and supplies an overall improvement of 13.28% in terms of average prequential accuracy.


title: Unitary Checkerboard Precoded OFDM for Low-PAPR Optical Wireless Communications

abstract: Future 6G wireless networks will once again have to raise the capability in most of the technology domains by a factor of 10-100. Depending on the application, future requirements include peak data rates of 1Tb/s per user, 0.1ms latency, less than 1 out of a million outage, centimetre accurate positioning, near zero energy consumption at the device, and operation in different environments including factories, vehicles, and more. Optical wireless communications (OWC) have the potential to provide ultra-high data rates in a cost effective way, thanks to the vast and freely available light spectrum, and the availability of devices for transmitters and receivers. 5G NR architecture permits the integration of stand-alone OWC nodes on network layer. Current 6G research investigates advanced physical layer designs including OWC-compatible waveforms. In this context, in this paper a new pre-coded orthogonal frequency division multiplexing (OFDM) waveform is proposed that is tailored to the OWC specific needs. Its prime advantage compared to OFDM is the ultra-low peak-to-average power ratio (PAPR), while preserving other benefits, such as high spectral efficiency, flexible subcarrier nulling, and low computational complexity.


title: A novel approach for MBSFN Area Formation aided by D2D Communications for eMBB Service Delivery in 5G NR Systems

abstract: Forthcoming 5G New Radio (NR) systems will be asked to handle a huge number of devices accessing or delivering "resource-hungry" and high-quality services. In view of this, the new 5G Radio Access Technology (RAT) aims to support, in next releases, Multimedia Broadcast/Multicast Service Single Frequency Network (MBSFN) to enable the simultaneous delivery of the same content to a set of users covered by different cells. According to MBSFN, all cells belonging to the same MBSFN Area are synchronized in time and the MBSFN transmission occurs over the same radio resources. In such a way, the same content flow is delivered by several cells to all the receivers in the MBSFN Area. A further means to enhance the network coverage and provide high data rate and low latency in future 5G-enabled MBSFN networks is Device-to-Device (D2D) connectivity. Along these lines, in this paper we propose a D2D-aided MBSFN Area Formation (D2D-MAF) algorithm to dynamically create MBSFN Areas with the aim to improve the system aggregate data rate while satisfying all user requests. The proposed D2D-MAF foresees that users could receive the service through either MBSFN, or D2D, or unicast transmissions. Performance evaluation results, carried out under a wide range of conditions, testify to the high effectiveness of the proposed algorithm.


title: Space-Based Photometry Of Binary Stars: From Voyager To TESS

abstract: Binary stars are crucial laboratories for stellar physics, so have been photometric targets for space missions beginning with the very first orbiting telescope (OAO-2) launched in 1968. This review traces the binary stars observed and the scientific results obtained from the early days of ultraviolet missions (OAO-2, Voyager, ANS, IUE), through a period of diversification (Hipparcos, WIRE, MOST, BRITE), to the current era of large planetary transit surveys (CoRoT, Kepler, TESS). In this time observations have been obtained of detached, semi-detached and contact binaries containing dwarfs, sub-giants, giants, supergiants, white dwarfs, planets, neutron stars and accretion discs. Recent missions have found a huge variety of objects such as pulsating stars in eclipsing binaries, multi-eclipsers, heartbeat stars and binaries hosting transiting planets. Particular attention is paid to eclipsing binaries, because they are staggeringly useful, and to the NASA Transiting Exoplanet Survey Satellite (TESS) because its huge sky coverage enables a wide range of scientific investigations with unprecedented ease. These results are placed into context, future missions are discussed, and a list of important science goals is presented.


title: 3D Unsupervised Region-Aware Registration Transformer

abstract: This paper concerns the research problem of point cloud registration to find the rigid transformation to optimally align the source point set with the target one. Learning robust point cloud registration models with deep neural networks has emerged as a powerful paradigm, offering promising performance in predicting the global geometric transformation for a pair of point sets. Existing methods first leverage an encoder to regress the global shape descriptor, which is then decoded into a shape-conditioned transformation via concatenation-based conditioning. However, different regions of a 3D shape vary in their geometric structures which makes it more sense that we have a region-conditioned transformation instead of the shape-conditioned one. In this paper, we define our 3D registration function through the introduction of a new design of 3D region partition module that is able to divide the input shape to different regions with a self-supervised 3D shape reconstruction loss without the need for ground truth labels. We further propose the 3D shape transformer module to efficiently and effectively capture short- and long-range geometric dependencies for regions on the 3D shape Consequently, the region-aware decoder module is proposed to predict the transformations for different regions respectively. The global geometric transformation from the source point set to the target one is then formed by the weighted fusion of region-aware transformation. Compared to the state-of-the-art approaches, our experiments show that our 3D-URRT achieves superior registration performance over various benchmark datasets (e.g. ModelNet40).


title: Privacy-Preserving Coded Mobile Edge Computing for Low-Latency Distributed Inference

abstract: We consider a mobile edge computing scenario where a number of devices want to perform a linear inference $\boldsymbol{W}\boldsymbol{x}$ on some local data $\boldsymbol{x}$ given a network-side matrix $\boldsymbol{W}$. The computation is performed at the network edge over a number of edge servers. We propose a coding scheme that provides information-theoretic privacy against $z$ colluding (honest-but-curious) edge servers, while minimizing the overall latency\textemdash comprising upload, computation, download, and decoding latency\textemdash in the presence of straggling servers. The proposed scheme exploits Shamir's secret sharing to yield data privacy and straggler mitigation, combined with replication to provide spatial diversity for the download. We also propose two variants of the scheme that further reduce latency. For a considered scenario with $9$ edge servers, the proposed scheme reduces the latency by $8\%$ compared to the nonprivate scheme recently introduced by Zhang and Simeone, while providing privacy against an honest-but-curious edge server.


title: mRAT-SQL+GAP:A Portuguese Text-to-SQL Transformer

abstract: The translation of natural language questions to SQL queries has attracted growing attention, in particular in connection with transformers and similar language models. A large number of techniques are geared towards the English language; in this work, we thus investigated translation to SQL when input questions are given in the Portuguese language. To do so, we properly adapted state-of-the-art tools and resources. We changed the RAT-SQL+GAP system by relying on a multilingual BART model (we report tests with other language models), and we produced a translated version of the Spider dataset. Our experiments expose interesting phenomena that arise when non-English languages are targeted; in particular, it is better to train with original and translated training datasets together, even if a single target language is desired. This multilingual BART model fine-tuned with a double-size training dataset (English and Portuguese) achieved 83% of the baseline, making inferences for the Portuguese test dataset. This investigation can help other researchers to produce results in Machine Learning in a language different from English. Our multilingual ready version of RAT-SQL+GAP and the data are available, open-sourced as mRAT-SQL+GAP at: https://github.com/C4AI/gap-text2sql


title: Can we detect a supertranslated black hole?

abstract: We attempt to address the question of whether standard tests of general relativity can detect the presence of a black hole carrying a supertranslation field. In this regard, we study the photon sphere of a dynamical black hole carrying a supertranslation hair. We find that the dynamics of the photon sphere is quite subtle and it may offer an opportunity to differentiate a supertranslated black hole from its bald counterpart. This represents a first step towards understanding the observational signatures of a supertranslated dynamical black hole.


title: Pseudodifferential operators on filtered manifolds as generalized fixed points

abstract: On filtered manifolds one can define a different notion of order for the differential operators. In this paper, we use generalized fixed point algebras to construct a pseudodifferential extension that reflects this behaviour. In the corresponding calculus, the principal symbol of an operator is a family of operators acting on certain nilpotent Lie groups. The role of ellipticity as a Fredholm condition is replaced by the Rockland condition on these groups. Our approach allows to understand this in terms of the representation of the corresponding algebra of principal symbols. Moreover, we compute the $K$-theory of this algebra.


title: Bias-Variance Tradeoffs in Single-Sample Binary Gradient Estimators

abstract: Discrete and especially binary random variables occur in many machine learning models, notably in variational autoencoders with binary latent states and in stochastic binary networks. When learning such models, a key tool is an estimator of the gradient of the expected loss with respect to the probabilities of binary variables. The straight-through (ST) estimator gained popularity due to its simplicity and efficiency, in particular in deep networks where unbiased estimators are impractical. Several techniques were proposed to improve over ST while keeping the same low computational complexity: Gumbel-Softmax, ST-Gumbel-Softmax, BayesBiNN, FouST. We conduct a theoretical analysis of bias and variance of these methods in order to understand tradeoffs and verify the originally claimed properties. The presented theoretical results allow for better understanding of these methods and in some cases reveal serious issues.


title: Observation of enhanced free-electron radiation from photonic flatband resonances

abstract: Flatbands emerge from a myriad of structures such as Landau levels, Lieb and Kagome lattices, linegraphs, and more recently moire superlattices. They enable unique properties including slow light in photonics, correlated phases in electronics, and supercollimation in both systems. Despite these intense parallel efforts, flatbands have never been shown to affect the core light-matter interaction between electrons and photons, which is limited by a dimensionality mismatch. Here, we reveal that a photonic flatband can overcome this mismatch between localized electrons and extended photons and thus remarkably boost their light-matter interaction. We design flatband resonances in a silicon-on-insulator photonic crystal slab to control and enhance the radiation emission from free electrons by tuning their trajectory and velocity. In particular, we record a 100-fold radiation enhancement from the conventional diffraction-enabled Smith-Purcell radiation, and show the potential of our approach to achieve $10^6$-fold enhancements and beyond. The enhancement also enables us to perform polarization shaping of free electron radiation from multiple flatbands and demonstrate an approach to measure photonic bands via angle-resolved electron-beam measurements. Our results suggest flatbands as ideal test beds for strong light-electron interaction in various systems, with particular relevance for efficient and compact free-electron light sources and accelerators.


title: Formalizing Geometric Algebra in Lean

abstract: This paper explores formalizing Geometric (or Clifford) algebras into the Lean 3 theorem prover, building upon the substantial body of work that is the Lean mathematics library, mathlib. As we use Lean source code to demonstrate many of our ideas, we include a brief introduction to the Lean language targeted at a reader with no prior experience with Lean or theorem provers in general. We formalize the multivectors as the quotient of the tensor algebra by a suitable relation, which provides the ring structure automatically, then go on to establish the universal property of the Clifford algebra. We show that this is quite different to the approach taken by existing formalizations of Geometric algebra in other theorem provers; most notably, our approach does not require a choice of basis. We go on to show how operations and structure such as involutions, versors, and the $\mathbb{Z}_2$-grading can be defined using the universal property alone, and how to recover an induction principle from the universal property suitable for proving statements about these definitions. We outline the steps needed to formalize the wedge product and $\mathbb{N}$-grading, and some of the gaps in mathlib that currently make this challenging.


title: Heterogeneous Overdispersed Count Data Regressions via Double Penalized Estimations

abstract: This paper studies the non-asymptotic merits of the double $\ell_1$-regularized for heterogeneous overdispersed count data via negative binomial regressions. Under the restricted eigenvalue conditions, we prove the oracle inequalities for Lasso estimators of two partial regression coefficients for the first time, using concentration inequalities of empirical processes. Furthermore, derived from the oracle inequalities, the consistency and convergence rate for the estimators are the theoretical guarantees for further statistical inference. Finally, both simulations and a real data analysis demonstrate that the new methods are effective.


title: Shift-BNN: Highly-Efficient Probabilistic Bayesian Neural Network Training via Memory-Friendly Pattern Retrieving

abstract: Bayesian Neural Networks (BNNs) that possess a property of uncertainty estimation have been increasingly adopted in a wide range of safety-critical AI applications which demand reliable and robust decision making, e.g., self-driving, rescue robots, medical image diagnosis. The training procedure of a probabilistic BNN model involves training an ensemble of sampled DNN models, which induces orders of magnitude larger volume of data movement than training a single DNN model. In this paper, we reveal that the root cause for BNN training inefficiency originates from the massive off-chip data transfer by Gaussian Random Variables (GRVs). To tackle this challenge, we propose a novel design that eliminates all the off-chip data transfer by GRVs through the reversed shifting of Linear Feedback Shift Registers (LFSRs) without incurring any training accuracy loss. To efficiently support our LFSR reversion strategy at the hardware level, we explore the design space of the current DNN accelerators and identify the optimal computation mapping scheme to best accommodate our strategy. By leveraging this finding, we design and prototype the first highly efficient BNN training accelerator, named Shift-BNN, that is low-cost and scalable. Extensive evaluation on five representative BNN models demonstrates that Shift-BNN achieves an average of 4.9x (up to 10.8x) boost in energy efficiency and 1.6x (up to 2.8x) speedup over the baseline DNN training accelerator.


title: The structure of higher sumsets

abstract: Merging together a result of Nathanson from the early 70s and a recent result of Granville and Walker, we show that for any finite set $A$ of integers with $\min(A)=0$ and $\gcd(A)=1$ there exist two sets, the "head" and the "tail", such that if $m\ge\max(A)-|A|+2$, then the $m$-fold sumset $mA$ consists of the union of these sets and a long block of consecutive integers separating them. We give sharp estimates for the length of the block, and investigate the corresponding stability problem classifying those sets $A$ for which the bound $\max(A)-|A|+2$ cannot be substantially improved.


title: Active Extrinsic Contact Sensing: Application to General Peg-in-Hole Insertion

abstract: We propose a method that actively estimates contact location between a grasped rigid object and its environment and uses this as input to a peg-in-hole insertion policy. An estimation model and an active tactile feedback controller work collaboratively to estimate the external contacts accurately. The controller helps the estimation model get a better estimate by regulating a consistent contact mode. The better estimation makes it easier for the controller to regulate the contact. We then train an object-agnostic insertion policy that learns to use the series of contact estimates to guide the insertion of an unseen peg into a hole. In contrast with previous works that learn a policy directly from tactile signals, since this policy is in contact configuration space, it can be learned directly in simulation. Lastly, we demonstrate and evaluate the active extrinsic contact line estimation and the trained insertion policy together in a real experiment. We show that the proposed method inserts various-shaped test objects with higher success rates and fewer insertion attempts than previous work with end-to-end approaches. See supplementary video and results at https://sites.google.com/view/active-extrinsic-contact.


title: Topological lower bounds on the sizes of simplicial complexes and regular simplicial sets

abstract: We prove that if an $n$-dimensional space $X$ satisfies certain topological conditions then any triangulation of $X$ as well as any regular simplicial set homeomorphic to $X$ has at least $2^n$ simplices of dimension $n$. One example of such $X$ is the $n$-dimensional torus $(S^1)^n$.


title: Group synchrony, parameter mismatches, and intragroup connections

abstract: Group synchronization arises when two or more synchronization patterns coexist in a network formed of oscillators of different types, with the systems in each group synchronizing on the same time-evolution, but systems in different groups synchronizing on distinct time-evolutions. Group synchronization has been observed and characterized when the systems in each group are identical and the couplings between the systems satisfy specific conditions. By relaxing these constraints and allowing them to be satisfied in an approximate rather than exact way, we observe that stable group synchronization may still occur in the presence of small deviations of the parameters of the individual systems and of the couplings from their nominal values. We analyze this case and provide necessary and sufficient conditions for stability through a master stability function approach, {which also allows us to quantify the synchronization error}. We also investigate the stability of group synchronization in the presence of intra group connections and for this case, extend some of the existing results in the literature. Our analysis points out a broader class of matrices describing intra group connections for which the stability problem can be reduced in a low-dimensional form.


title: BCF-groups with elevated rank distribution

abstract: Infinitely many large Schur sigma-groups G with logarithmic order lo(G)=19+e, non-elementary bicyclic commutator quotient G/G' ~ C(3^e) x C(3), e >= 2, elevated rank distribution rho(G)=(3,3,3;3), punctured transfer kernel type kappa(G) ~ (144;4) and soluble length sl(G)=3 are constructed. Up to e <= 4, they are realized as 3-class field tower groups Gal(F(3,infty,K)/K) of imaginary quadratic number fields K=Q(d^1/2), d<0. Their metabelianizations M=G/G'' are BCF-groups with lo(M)=8+e and bicyclic third lower central factor gamma3(M)/gamma4(M) ~ C(3) x C(3).


title: Testing Models of Triggered Star Formation with Young Stellar Objects in Cepheus OB4

abstract: OB associations are home to newly formed massive stars, whose turbulent winds and ionizing flux create H II regions rich with star formation. Studying the distribution and abundance of young stellar objects (YSOs) in these ionized bubbles can provide essential insight into the physical processes that shape their formation, allowing us to test competing models of star formation. In this work, we examined one such OB association, Cepheus OB4 (Cep OB4) - a well-suited region for studying YSOs due to its Galactic location, proximity, and geometry. We created a photometric catalog from Spitzer/IRAC mosaics in bands 1 (3.6 $\mu$m) and 2 (4.5 $\mu$m). We supplemented the catalog with photometry from WISE, 2MASS, IRAC bands 3 (5.8 $\mu$m) and 4 (8.0 $\mu$m), MIPS 24 $\mu$m, and MMIRS near IR data. We used color-color selections to identify 821 YSOs, which we classified using the IR slope of the YSOs' spectral energy distributions (SEDs), finding 67 Class I, 103 flat spectrum, 569 Class II, and 82 Class III YSOs. We conducted a clustering analysis of the Cep OB4 YSOs and fit their SEDs. We found many young Class I objects distributed in the surrounding shell and pillars as well as a relative age gradient of unclustered sources, with YSOs generally decreasing in age with distance from the central cluster. Both of these results indicate that the expansion of the H II region may have triggered star formation in Cep OB4.


title: Magic dust for cross-lingual adaptation of monolingual wav2vec-2.0

abstract: We propose a simple and effective cross-lingual transfer learning method to adapt monolingual wav2vec-2.0 models for Automatic Speech Recognition (ASR) in resource-scarce languages. We show that a monolingual wav2vec-2.0 is a good few-shot ASR learner in several languages. We improve its performance further via several iterations of Dropout Uncertainty-Driven Self-Training (DUST) by using a moderate-sized unlabeled speech dataset in the target language. A key finding of this work is that the adapted monolingual wav2vec-2.0 achieves similar performance as the topline multilingual XLSR model, which is trained on fifty-three languages, on the target language ASR task.


title: The Martens-Mumford Theorem and the Green-Lazarsfeld Secant Conjecture

abstract: The Green-Lazarsfeld secant conjecture predicts that the syzygies of a curve of sufficiently high degree are controlled by its special secants. We prove this conjecture for all curves of Clifford index at least two and not bielliptic and for all line bundles of a certain degree. Our proof is based on a classic result of Martens and Mumford on Brill-Noether varieties and on a simple vanishing criterion that comes from the interpretation of syzygies through symmetric products of curves.


title: Weakly Supervised Human-Object Interaction Detection in Video via Contrastive Spatiotemporal Regions

abstract: We introduce the task of weakly supervised learning for detecting human and object interactions in videos. Our task poses unique challenges as a system does not know what types of human-object interactions are present in a video or the actual spatiotemporal location of the human and the object. To address these challenges, we introduce a contrastive weakly supervised training loss that aims to jointly associate spatiotemporal regions in a video with an action and object vocabulary and encourage temporal continuity of the visual appearance of moving objects as a form of self-supervision. To train our model, we introduce a dataset comprising over 6.5k videos with human-object interaction annotations that have been semi-automatically curated from sentence captions associated with the videos. We demonstrate improved performance over weakly supervised baselines adapted to our task on our video dataset.


title: Impact of charged and neutral Drell-Yan Asymmetries on precision measurements

abstract: We study the impact of future measurements of lepton-charge and forward-backward asymmetries on PDF determination. These results have been obtained employing standard profiling procedures and the open-source platform xFitter. The potential of the combination of charged-current and neutral-current Drell-Yan asymmetries in regions of transverse and invariant masses near the W/Z bosons peaks to improve the PDF uncertainties has also been explored.


title: Spectral single photons characterization using generalized Hong, Ou and Mandel interferometry

abstract: New methods are proposed to characterize the spectral-temporal distribution of single photons. The presented protocols take advantage of spectral filtering, frequency entanglement between two single photons the one of interest and a reference, followed by the generalized Hong, Ou and Mandel interferometer. The measurement of the coincidence probability in these different schemes reveals the chronocyclic Wigner, the pseudo-Wigner distribution and the spectrogram at the single-photon level.


title: Solutions to nonlocal evolution equations governed by non-autonomous forms and demicontinuous nonlinearities

abstract: We deal with the existence of solutions having L2 regularity for a class of non autonomous evolution equations. Associated with the equation, a general non local condition is studied. The technique we used combines a finite dimensional reduction together with the Leray-Schauder continuation principle. This approach permits to consider a wide class of nonlinear terms by allowing demicontinuity assumptions on the nonlinearity.


title: Laplacians on infinite graphs: discrete vs continuous

abstract: There are two main notions of a Laplacian operator associated with graphs: discrete graph Laplacians and continuous Laplacians on metric graphs (widely known as quantum graphs). Both objects have a venerable history as they are related to several diverse branches of mathematics and mathematical physics. The existing literature usually treats these two Laplacian operators separately. In this overview, we will focus on the relationship between them (spectral and parabolic properties). Our main conceptual message is that these two settings should be regarded as complementary (rather than opposite) and exactly their interplay leads to important further insight on both sides.


title: GeSERA: General-domain Summary Evaluation by Relevance Analysis

abstract: We present GeSERA, an open-source improved version of SERA for evaluating automatic extractive and abstractive summaries from the general domain. SERA is based on a search engine that compares candidate and reference summaries (called queries) against an information retrieval document base (called index). SERA was originally designed for the biomedical domain only, where it showed a better correlation with manual methods than the widely used lexical-based ROUGE method. In this paper, we take out SERA from the biomedical domain to the general one by adapting its content-based method to successfully evaluate summaries from the general domain. First, we improve the query reformulation strategy with POS Tags analysis of general-domain corpora. Second, we replace the biomedical index used in SERA with two article collections from AQUAINT-2 and Wikipedia. We conduct experiments with TAC2008, TAC2009, and CNNDM datasets. Results show that, in most cases, GeSERA achieves higher correlations with manual evaluation methods than SERA, while it reduces its gap with ROUGE for general-domain summary evaluation. GeSERA even surpasses ROUGE in two cases of TAC2009. Finally, we conduct extensive experiments and provide a comprehensive study of the impact of human annotators and the index size on summary evaluation with SERA and GeSERA.


title: Trotter errors from dynamical structural instabilities of Floquet maps in quantum simulation

abstract: We study the behavior of errors in the quantum simulation of spin systems with long-range multi-body interactions resulting from the Trotter-Suzuki decomposition of the time-evolution operator. We identify a regime where the Floquet operator underlying the Trotter decomposition undergoes sharp changes even for small variations in the simulation step size. This results in a time evolution operator that is very different from the dynamics generated by the targeted Hamiltonian, which leads to a proliferation of errors in the quantum simulation. These regions of sharp change in the Floquet operator, referred to as structural instability regions, appear typically at intermediate Trotter step sizes and in the weakly-interacting regime, and are thus complementary to recently revealed quantum chaotic regimes of the Trotterized evolution (Sieberer et al., npj Quantum Information 5, 1 (2019)). We characterize these structural instability regimes in $p$-spin models, transverse-field Ising models with all-to-all $p$-body interactions, and analytically predict their occurrence based on unitary perturbation theory. We further show that the effective Hamiltonian associated with the Trotter decomposition of the unitary time-evolution operator, when the Trotter-step size is chosen to be in the structural instability region, is very different from the target Hamiltonian, which explains the large errors that can occur in the simulation in the regions of instability. These results have implications for the reliability of near-term gate-based quantum simulators, and reveal an important interplay between errors and the physical properties of the system being simulated.


title: Human in the Loop for Machine Creativity

abstract: Artificial intelligence (AI) is increasingly utilized in synthesizing visuals, texts, and audio. These AI-based works, often derived from neural networks, are entering the mainstream market, as digital paintings, songs, books, and others. We conceptualize both existing and future human-in-the-loop (HITL) approaches for creative applications and to develop more expressive, nuanced, and multimodal models. Particularly, how can our expertise as curators and collaborators be encoded in AI models in an interactive manner? We examine and speculate on long term implications for models, interfaces, and machine creativity. Our selection, creation, and interpretation of AI art inherently contain our emotional responses, cultures, and contexts. Therefore, the proposed HITL may help algorithms to learn creative processes that are much harder to codify or quantify. We envision multimodal HITL processes, where texts, visuals, sounds, and other information are coupled together, with automated analysis of humans and environments. Overall, these HITL approaches will increase interaction between human and AI, and thus help the future AI systems to better understand our own creative and emotional processes.


title: Frustration induced inversion of magnetocaloric effect and enhanced cooling power in substituted Pyrochlore Iridates

abstract: We investigate the effect of partial replacement of extended 5d Ir4+ sites by localized 3d Cr3+ moments on the magnetocaloric properties of Y2Ir2O7 (YIO) pyrochlore iridates. We find that Y2Ir2-xCrxO7 (YICO) undergoes cluster glass transition, possibly due to RKKY like interaction between localized Cr3+ moments occupying random sites in the pyrochlore network, mediated by 5d Ir conduction electrons. The coexistence of ferromagnetic and antiferromagnetic clusters give rise to the conventional and inverse magnetocaloric effect (MCE). We observe significant enhancement of conventional as well as inverse MCE with substitution. Although the value of conventional MCE and inverse MCE in substituted Iridates are not large, the effect spans over a giant working temperature window, thus leading to orders of magnitude enhancement of cooling power, the value being comparable to standard magnetocalric materials.


title: Multimode Mamyshev Oscillator

abstract: We present a spatiotemporally mode-locked Mamyshev oscillator. A wide variety of multimode mode-locked states, with varying degrees of spatiotemporal coupling, are observed. We find that some control of the modal content of the output beam is possible through the cavity design. Comparison of simulations to experiments indicates that spatiotemporal mode-locking is enabled by nonlinear intermodal interactions and spatial filtering, along with the Mamyshev mechanism. This work represents a first exploration of spatiotemporal mode-locking in an oscillator with the Mamyshev saturable absorber.


title: Bridge to Target Domain by Prototypical Contrastive Learning and Label Confusion: Re-explore Zero-Shot Learning for Slot Filling

abstract: Zero-shot cross-domain slot filling alleviates the data dependence in the case of data scarcity in the target domain, which has aroused extensive research. However, as most of the existing methods do not achieve effective knowledge transfer to the target domain, they just fit the distribution of the seen slot and show poor performance on unseen slot in the target domain. To solve this, we propose a novel approach based on prototypical contrastive learning with a dynamic label confusion strategy for zero-shot slot filling. The prototypical contrastive learning aims to reconstruct the semantic constraints of labels, and we introduce the label confusion strategy to establish the label dependence between the source domains and the target domain on-the-fly. Experimental results show that our model achieves significant improvement on the unseen slots, while also set new state-of-the-arts on slot filling task.


title: Minimum word error training for non-autoregressive Transformer-based code-switching ASR

abstract: Non-autoregressive end-to-end ASR framework might be potentially appropriate for code-switching recognition task thanks to its inherent property that present output token being independent of historical ones. However, it still under-performs the state-of-the-art autoregressive ASR frameworks. In this paper, we propose various approaches to boosting the performance of a CTC-mask-based nonautoregressive Transformer under code-switching ASR scenario. To begin with, we attempt diversified masking method that are closely related with code-switching point, yielding an improved baseline model. More importantly, we employ MinimumWord Error (MWE) criterion to train the model. One of the challenges is how to generate a diversified hypothetical space, so as to obtain the average loss for a given ground truth. To address such a challenge, we explore different approaches to yielding desired N-best-based hypothetical space. We demonstrate the efficacy of the proposed methods on SEAME corpus, a challenging English-Mandarin code-switching corpus for Southeast Asia community. Compared with the crossentropy-trained strong baseline, the proposed MWE training method achieves consistent performance improvement on the test sets.


title: A New Simple Vision Algorithm for Detecting the Enzymic Browning Defects in Golden Delicious Apples

abstract: In this work, a simple vision algorithm is designed and implemented to extract and identify the surface defects on the Golden Delicious apples caused by the enzymic browning process. 34 Golden Delicious apples were selected for the experiments, of which 17 had enzymic browning defects and the other 17 were sound. The image processing part of the proposed vision algorithm extracted the defective surface area of the apples with high accuracy of 97.15%. The area and mean of the segmented images were selected as the 2x1 feature vectors to feed into a designed artificial neural network. The analysis based on the above features indicated that the images with a mean less than 0.0065 did not belong to the defective apples; rather, they were extracted as part of the calyx and stem of the healthy apples. The classification accuracy of the neural network applied in this study was 99.19%


title: Estimating Image Depth in the Comics Domain

abstract: Estimating the depth of comics images is challenging as such images a) are monocular; b) lack ground-truth depth annotations; c) differ across different artistic styles; d) are sparse and noisy. We thus, use an off-the-shelf unsupervised image to image translation method to translate the comics images to natural ones and then use an attention-guided monocular depth estimator to predict their depth. This lets us leverage the depth annotations of existing natural images to train the depth estimator. Furthermore, our model learns to distinguish between text and images in the comics panels to reduce text-based artefacts in the depth estimates. Our method consistently outperforms the existing state-ofthe-art approaches across all metrics on both the DCM and eBDtheque images. Finally, we introduce a dataset to evaluate depth prediction on comics. Our project website can be accessed at https://github.com/IVRL/ComicsDepth.


title: Training Stable Graph Neural Networks Through Constrained Learning

abstract: Graph Neural Networks (GNN) rely on graph convolutions to learn features from network data. GNNs are stable to different types of perturbations of the underlying graph, a property that they inherit from graph filters. In this paper we leverage the stability property of GNNs as a typing point in order to seek for representations that are stable within a distribution. We propose a novel constrained learning approach by imposing a constraint on the stability condition of the GNN within a perturbation of choice. We showcase our framework in real world data, corroborating that we are able to obtain more stable representations while not compromising the overall accuracy of the predictor.


title: Polynomial removal lemmas for ordered graphs

abstract: A recent result of Alon, Ben-Eliezer and Fischer establishes an induced removal lemma for ordered graphs. That is, if $F$ is an ordered graph and $\varepsilon>0$, then there exists $\delta_{F}(\varepsilon)>0$ such that every $n$-vertex ordered graph $G$ containing at most $\delta_{F}(\varepsilon) n^{v(F)}$ induced copies of $F$ can be made induced $F$-free by adding/deleting at most $\varepsilon n^2$ edges. We prove that $\delta_{F}(\varepsilon)$ can be chosen to be a polynomial function of $\varepsilon$ if and only if $|V(F)|=2$, or $F$ is the ordered graph with vertices $x<y<z$ and edges $\{x,y\},\{x,z\}$ (up to complementation and reversing the vertex order). We also discuss similar problems in the non-induced case.


title: Towards Accurate Cross-Domain In-Bed Human Pose Estimation

abstract: Human behavioral monitoring during sleep is essential for various medical applications. Majority of the contactless human pose estimation algorithms are based on RGB modality, causing ineffectiveness in in-bed pose estimation due to occlusions by blankets and varying illumination conditions. Long-wavelength infrared (LWIR) modality based pose estimation algorithms overcome the aforementioned challenges; however, ground truth pose generations by a human annotator under such conditions are not feasible. A feasible solution to address this issue is to transfer the knowledge learned from images with pose labels and no occlusions, and adapt it towards real world conditions (occlusions due to blankets). In this paper, we propose a novel learning strategy comprises of two-fold data augmentation to reduce the cross-domain discrepancy and knowledge distillation to learn the distribution of unlabeled images in real world conditions. Our experiments and analysis show the effectiveness of our approach over multiple standard human pose estimation baselines.


title: The root distributions of Ehrhart polynomials of free sums of reflexive polytopes

abstract: In this paper, we study the root distributions of Ehrhart polynomials of free sums of certain reflexive polytopes. We investigate cases where the roots of the Ehrhart polynomials of the free sums of $A_d^\vee$'s or $A_d$'s lie on the canonical line $\mathrm{Re}(z)=-\frac{1}{2}$ on the complex plane $\mathbb{C}$, where $A_d$ denotes the root polytope of type A of dimension $d$ and $A_d^\vee$ denotes its polar dual. For example, it is proved that $A_m^\vee \oplus A_n^\vee$ with $\min\{m,n\} \leq 1$ or $m+n \leq 7$, $A_2^\vee \oplus (A_1^\vee)^{\oplus n}$ and $A_3^\vee \oplus (A_1^\vee)^{\oplus n}$ for any $n$ satisfy this property. We also perform computational experiments for other types of free sums of $A_n^\vee$'s or $A_n$'s.


title: A Model Selection Approach for Corruption Robust Reinforcement Learning

abstract: We develop a model selection approach to tackle reinforcement learning with adversarial corruption in both transition and reward. For finite-horizon tabular MDPs, without prior knowledge on the total amount of corruption, our algorithm achieves a regret bound of $\widetilde{\mathcal{O}}(\min\{\frac{1}{\Delta}, \sqrt{T}\}+C)$ where $T$ is the number of episodes, $C$ is the total amount of corruption, and $\Delta$ is the reward gap between the best and the second-best policy. This is the first worst-case optimal bound achieved without knowledge of $C$, improving previous results of Lykouris et al. (2021); Chen et al. (2021); Wu et al. (2021). For finite-horizon linear MDPs, we develop a computationally efficient algorithm with a regret bound of $\widetilde{\mathcal{O}}(\sqrt{(1+C)T})$, and another computationally inefficient one with $\widetilde{\mathcal{O}}(\sqrt{T}+C)$, improving the result of Lykouris et al. (2021) and answering an open question by Zhang et al. (2021b). Finally, our model selection framework can be easily applied to other settings including linear bandits, linear contextual bandits, and MDPs with general function approximation, leading to several improved or new results.


title: Properties of Mixing BV vector fields

abstract: We consider the density properties of divergence-free vector fields $ b \in L^1([0,1],\textit{BV}([0,1]^2)) $ which are ergodic/weakly mixing/strongly mixing: this means that their Regular Lagrangian Flow $X_t$ is an ergodic/weakly mixing/strongly mixing measure preserving map when evaluated at $t=1$. Our main result is that there exists a $G_\delta$-set $\mathcal U \subset L^1_{t,x}([0,1]^3)$ made of divergence-free vector fields such that $1)$ the map $\Phi$ associating $b$ with its RLF $X_t$ can be extended as a continuous function to the $G_\delta$-set $\mathcal{U}$; $2)$ ergodic vector fields $b$ are a residual $G_\delta$-set in $\mathcal{U}$; $3)$ weakly mixing vector fields $b$ are a residual $G_\delta$-set in $\mathcal{U}$; $4)$ strongly mixing vector fields $b$ are a first category set in $\mathcal{U}$; $5)$ exponentially (fast) mixing vector fields are a dense subset of $\mathcal{U}$. The proof of these results is based on the density of BV vector fields such that $X_{t=1}$ is a permutation of subsquares, and suitable perturbations of this flow to achieve the desired ergodic/mixing behavior. These approximation results have an interest of their own. A discussion on the extension of these results to $d \geq 3$ is also presented.


title: Non-adaptive Heisenberg-limited metrology with multi-channel homodyne measurements

abstract: We show a protocol achieving the ultimate Heisenberg-scaling sensitivity in the estimation of a parameter encoded in a generic linear network, without employing any auxiliary networks, and without the need of any prior information on the parameter nor on the network structure. As a result, this protocol does not require a prior coarse estimation of the parameter, nor an adaptation of the network. The scheme we analyse consists of a single-mode squeezed state and homodyne detectors in each of the $M$ output channels of the network encoding the parameter, making it feasible for experimental applications.


title: Spatial aspects of spin polarization of structurally split surface states in thin films with magnetic exchange and spin-orbit interaction

abstract: A theoretical study is presented of the effect of an in-plane magnetic exchange field on the band structure of centrosymmetric films of noble metals and topological insulators. Based on an ab initio relativistic $\mathbf{k}\cdot\mathbf{p}$ theory, a minimal effective model is developed that describes two coupled copies of a Rashba or Dirac electronic system residing at the opposite surfaces of the film. The coupling leads to a structural gap at $\bar{\Gamma}$ and causes an exotic redistribution of the spin density in the film when the exchange field is introduced. We apply the model to a nineteen-layer Au(111) film and to a five-quintuple-layer Sb$_2$Te$_3$ film. We demonstrate that at each film surface the exchange field induces spectrum distortions similar to those known for Rashba or Dirac surface states with an important difference due to the coupling: At some energies, one branch of the state loses its counterpart with the oppositely directed group velocity. This suggests that a large-angle electron scattering between the film surfaces through the interior of the film is dominant or even the only possible for such energies. The spin-density redistribution accompanying the loss of the counterpart favors this scattering channel.


title: Mixer-TTS: non-autoregressive, fast and compact text-to-speech model conditioned on language model embeddings

abstract: This paper describes Mixer-TTS, a non-autoregressive model for mel-spectrogram generation. The model is based on the MLP-Mixer architecture adapted for speech synthesis. The basic Mixer-TTS contains pitch and duration predictors, with the latter being trained with an unsupervised TTS alignment framework. Alongside the basic model, we propose the extended version which additionally uses token embeddings from a pre-trained language model. Basic Mixer-TTS and its extended version achieve a mean opinion score (MOS) of 4.05 and 4.11, respectively, compared to a MOS of 4.27 of original LJSpeech samples. Both versions have a small number of parameters and enable much faster speech synthesis compared to the models with similar quality.


title: To Charge or to Sell? EV Pack Useful Life Estimation via LSTMs, CNNs, and Autoencoders

abstract: Electric vehicles (EVs) are spreading fast as they promise to provide better performance and comfort, but above all, to help face climate change. Despite their success, their cost is still a challenge. Lithium-ion batteries are one of the most expensive EV components, and have become the standard for energy storage in various applications. Precisely estimating the remaining useful life (RUL) of battery packs can encourage their reuse and thus help to reduce the cost of EVs and improve sustainability. A correct RUL estimation can be used to quantify the residual market value of the battery pack. The customer can then decide to sell the battery when it still has a value, i.e., before it exceeds the end of life of the target application, so it can still be reused in a second domain without compromising safety and reliability. This paper proposes and compares two deep learning approaches to estimate the RUL of Li-ion batteries: LSTM and autoencoders vs. CNN and autoencoders. The autoencoders are used to extract useful features, while the subsequent network is then used to estimate the RUL. Compared to what has been proposed so far in the literature, we employ measures to ensure the method's applicability in the actual deployed application. Such measures include (1) avoiding using non-measurable variables as input, (2) employing appropriate datasets with wide variability and different conditions, and (3) predicting the remaining ampere-hours instead of the number of cycles. The results show that the proposed methods can generalize on datasets consisting of numerous batteries with high variance.


title: Optimization of a Fixed Virtual Sensing Feedback ANC Controller for In-Ear Headphones with Multiple Loudspeakers

abstract: In this paper we consider an in-ear headphone equipped with an inner microphone and multiple loudspeakers and we propose an optimization procedure with a convex objective function to derive a fixed multi-loudspeaker ANC controller aiming at minimizing the sound pressure at the ear drum. Based on the virtual microphone arrangement (VMA) technique and measured acoustic paths between the loudspeakers and the ear drum, the FIR filters of the ANC controller are jointly optimized to minimize the power spectral density at the ear drum, subject to design and stability constraints. For an in-ear headphone with two loudspeakers, the proposed multi-loudspeaker VMA controller is compared to two single-loudspeaker VMA controllers. Simulation results with diffuse noise show that the multi-loudspeaker VMA controller effectively improves the attenuation by up to about 10 dB for frequencies below 300 Hz when compared to both single-loudspeaker VMA controllers.


title: The Effect of Age on the Grouping of Open Clusters: The Primordial Group Hypothesis

abstract: The Primordial group hypothesis states that only young enough open clusters (OCs) can be multiple, and old OCs are essentially single since the gravitational interaction between OCs in primordial groups is very weak, and the probability of gravitational capture of two unrelated OCs without disruption is very low. We test such postulate through four different studies using a manual search of Gaia EDR3 and extensive literature. First, we revisit the work of de La Fuente Marcos & de La Fuente Marcos (2009), which states that only ca. 40% of the OCs pairs are of primordial origin. However, no plausible binary system among their proposed OC pairs having at least one member older than 0.1 Gyr has been found. Second, we research among the youngest OCs (age < 0.01 Gyr) in Tarricq et al. (2021) and obtain that ca. 71% of them remain in their primordial groups. Third, a similar study of the oldest OCs (age > 4 Gyr) shows that they are essentially alone. Forth, the well-known case of the double cluster in Perseus is shown also to accommodate the title hypothesis. A simplified bimodal model allows retrieving the overall fraction of linked OCs (around 12-16 %) from our results, assuming that young clusters remain associated ~0.04 Gyr. The obtained results further support that OCs are born in groups (Casado 2021).


title: A transformer-based deep learning approach for classifying brain metastases into primary organ sites using clinical whole brain MRI

abstract: Treatment decisions for brain metastatic disease rely on knowledge of the primary organ site, and currently made with biopsy and histology. Here we develop a novel deep learning approach for accurate non-invasive digital histology with whole-brain MRI data. Our IRB-approved single-site retrospective study was comprised of patients (n=1,399) referred for MRI treatment-planning and gamma knife radiosurgery over 21 years. Contrast-enhanced T1-weighted and T2-weighted Fluid-Attenuated Inversion Recovery brain MRI exams (n=1,582) were preprocessed and input to the proposed deep learning workflow for tumor segmentation, modality transfer, and primary site classification into one of five classes. Ten-fold cross-validation generated overall AUC of 0.878 (95%CI:0.873,0.883), lung class AUC of 0.889 (95%CI:0.883,0.895), breast class AUC of 0.873 (95%CI:0.860,0.886), melanoma class AUC of 0.852 (95%CI:0.842,0.862), renal class AUC of 0.830 (95%CI:0.809,0.851), and other class AUC of 0.822 (95%CI:0.805,0.839). These data establish that whole-brain imaging features are discriminative to allow accurate diagnosis of the primary organ site of malignancy. Our end-to-end deep radiomic approach has great potential for classifying metastatic tumor types from whole-brain MRI images. Further refinement may offer an invaluable clinical tool to expedite primary cancer site identification for precision treatment and improved outcomes.


title: Mapping Structural Heterogeneity at the Nanoscale with Scanning Nano-structure Electron Microscopy (SNEM)

abstract: Here we explore the use of scanning electron diffraction coupled with electron atomic pair distribution function analysis (ePDF) to understand the local order as a function of position in a complex multicomponent system, a hot rolled, Ni-encapsulated, Zr$_{65}$Cu$_{17.5}$Ni$_{10}$Al$_{7.5}$ bulk metallic glass (BMG), with a spatial resolution of 3 nm. We show that it is possible to gain insight into the chemistry and chemical clustering/ordering tendency in different regions of the sample, including in the vicinity of nano-scale crystallites that are identified from virtual dark field images and in heavily deformed regions at the edge of the BMG. In addition to simpler analysis, unsupervised machine learning was used to extract partial PDFs from the material, modeled as a quasi-binary alloy, and map them in space. These maps allowed key insights not only into the local average composition, as validated by EELS, but also a unique insight into chemical short-range ordering tendencies in different regions of the sample during formation. The experiments are straightforward and rapid and, unlike spectroscopic measurements, don't require energy filters on the instrument. We spatially map different quantities of interest (QoI's), defined as scalars that can be computed directly from positions and widths of ePDF peaks or parameters refined from fits to the patterns. We developed a flexible and rapid data reduction and analysis software framework that allows experimenters to rapidly explore images of the sample on the basis of different QoI's. The power and flexibility of this approach are explored and described in detail. Because of the fact that we are getting spatially resolved images of the nanoscale structure obtained from ePDFs we call this approach scanning nano-structure electron microscopy (SNEM), and we believe that it will be powerful and useful extension of current 4D-STEM methods.


title: Jet Drift and Collective Flow in Heavy-Ion Collisions

abstract: We study the tomographic applications of a new phenomenon we dub "jet drift" -- the deflection of high-energy particles and jets toward the direction of a flowing medium -- to the quark-gluon plasma produced in heavy-ion collisions. While the physics of jet drift is quite general, for specificity we consider the case of photon-jet production at mid-rapidity. Beginning with the simplest possible model, a large slab of uniformly flowing plasma, we systematically introduce the geometrical elements of a heavy-ion collision in a simple optical Glauber model. We find that the moving medium causes the jet to drift in the direction of the flow, bending its trajectory and leaving detailed signatures of the flow pattern in the distribution of $\gamma + \: \mathrm{jet}$ acoplanarities. In the elliptical geometries produced in non-central collisions, this drift effect leads to a strong geometry coupling which persists despite the addition of event-by-event fluctuations in the jet production point, impact parameter, and acoplanarity. We propose a new observable to measure the jet drift effect through the correlation of $\gamma + \: \mathrm{jet}$ acoplanarities with the elliptic flow of soft particles. Preliminary estimates suggest this correlation may be studied at sPHENIX and the LHC.


title: The smearing scale in Laguerre reconstructions of the correlation function

abstract: To a good approximation, on large cosmological scales the evolved two-point correlation function of biased tracers is related to the initial one by a convolution. For Gaussian initial conditions, the smearing kernel is Gaussian, so if the initial correlation function is parametrized using simple polynomials then the evolved correlation function is a sum of generalized Laguerre functions of half-integer order. This motivates an analytic Laguerre reconstruction algorithm which previous work has shown is fast and accurate. This reconstruction requires as input the width of the smearing kernel. We show that the method can be extended to estimate the width of the smearing kernel from the same dataset. This estimate, and associated uncertainties, can then be used to marginalize over the distribution of reconstructed shapes, and hence provide error estimates on the value of the distance scale which are not tied to a particular cosmological model. We also show that if, instead, we parametrize the evolved correlation function using simple polynomials, then the initial one is a sum of Hermite polynomials, again enabling fast and accurate deconvolution. If one is willing to use constraints on the smearing scale from other datasets, then marginalizing over its value is simpler for Hermite reconstruction, potentially providing further speed-up in cosmological analyses.


title: Phase-space representation of diffraction in time: Analytic results

abstract: Diffraction in time manifests itself as the appearance of probability-density fringes when a matter wave passes through an opaque screen with abrupt temporal variations of transmission properties. Here we analytically describe the phase-space structure of diffraction-in-time fringes for a class of smooth time gratings. More precisely, we obtain an analytic expression for the Husimi distribution representing the state of the system in the case of time gratings comprising a succession of Lorentzian-like slits. In particular, for a double-slit scenario, we derive a simple and intuitive expression that accurately captures the position of interference fringes in phase space.


title: TranSalNet: Towards perceptually relevant visual saliency prediction

abstract: Visual saliency prediction using transformers - Convolutional neural networks (CNNs) have significantly advanced computational modelling for saliency prediction. However, accurately simulating the mechanisms of visual attention in the human cortex remains an academic challenge. It is critical to integrate properties of human vision into the design of CNN architectures, leading to perceptually more relevant saliency prediction. Due to the inherent inductive biases of CNN architectures, there is a lack of sufficient long-range contextual encoding capacity. This hinders CNN-based saliency models from capturing properties that emulate viewing behaviour of humans. Transformers have shown great potential in encoding long-range information by leveraging the self-attention mechanism. In this paper, we propose a novel saliency model that integrates transformer components to CNNs to capture the long-range contextual visual information. Experimental results show that the transformers provide added value to saliency prediction, enhancing its perceptual relevance in the performance. Our proposed saliency model using transformers has achieved superior results on public benchmarks and competitions for saliency prediction models. The source code of our proposed saliency model TranSalNet is available at: https://github.com/LJOVO/TranSalNet


title: Ship Performance Monitoring using Machine-learning

abstract: The hydrodynamic performance of a sea-going ship varies over its lifespan due to factors like marine fouling and the condition of the anti-fouling paint system. In order to accurately estimate the power demand and fuel consumption for a planned voyage, it is important to assess the hydrodynamic performance of the ship. The current work uses machine-learning (ML) methods to estimate the hydrodynamic performance of a ship using the onboard recorded in-service data. Three ML methods, NL-PCR, NL-PLSR and probabilistic ANN, are calibrated using the data from two sister ships. The calibrated models are used to extract the varying trend in ship's hydrodynamic performance over time and predict the change in performance through several propeller and hull cleaning events. The predicted change in performance is compared with the corresponding values estimated using the fouling friction coefficient ($\Delta C_F$). The ML methods are found to be performing well while modelling the hydrodynamic state variables of the ships with probabilistic ANN model performing the best, but the results from NL-PCR and NL-PLSR are not far behind, indicating that it may be possible to use simple methods to solve such problems with the help of domain knowledge.


title: Generalization in Deep RL for TSP Problems via Equivariance and Local Search

abstract: Deep reinforcement learning (RL) has proved to be a competitive heuristic for solving small-sized instances of traveling salesman problems (TSP), but its performance on larger-sized instances is insufficient. Since training on large instances is impractical, we design a novel deep RL approach with a focus on generalizability. Our proposition consisting of a simple deep learning architecture that learns with novel RL training techniques, exploits two main ideas. First, we exploit equivariance to facilitate training. Second, we interleave efficient local search heuristics with the usual RL training to smooth the value landscape. In order to validate the whole approach, we empirically evaluate our proposition on random and realistic TSP problems against relevant state-of-the-art deep RL methods. Moreover, we present an ablation study to understand the contribution of each of its component


title: Experimental Realization of the 1D Random Field Ising Model

abstract: We have measured magnetic-field-induced avalanches in a square artificial spin ice array of interacting nanomagnets. Starting from the ground state ordered configuration, we imaged the individual nanomagnet moments after each successive application of an incrementally increasing field. The statistics of the evolution of the moment configuration show good agreement with the canonical one-dimensional random field Ising model. We extract information about the microscopic structure of the arrays from our macroscopic measurements of their collective behavior, demonstrating a process that could be applied to other systems exhibiting avalanches.


title: About a sequence of points and a relationship between pencils of conics and circles in the Euclidean plane

abstract: For a given triangle $\triangle ABC$, we define two sequences of points on line $BC$ and provide their generalizations to real functions such that centers of circumscribed circles around $A$ and adjacent points in subsequences generate a pencil of conics touching perpendicular bisectors of $AB$ and $AC$.