title: $K_{\ell 3}$ form factors at the physical point: Toward the continuum limit

abstract: We present updated results for the form factors of the kaon semileptonic $(K_{\ell 3})$ decay process calculated with $N_f = 2 + 1$ nonperturbatively $O(a)$-improved Wilson quark action and Iwasaki gauge action at the physical point on large volumes of more than (10 fm)$^4$. In addition to our previous calculation at the lattice spacing $a = 0.085$ fm, we perform a calculation at the second lattice spacing of $0.063$ fm. Using the results for the form factors extracted from 3-point functions with the local and also conserved vector currents at the two lattice spacings, continuum extrapolation and interpolation of the momentum transfer are carried out simultaneously to obtain the value of the form factor $f_+(0)$ at the zero momentum transfer in the continuum limit. After investigation of stability of $f_+(0)$ against several fit forms and different data, we obtain $f_+(0) = 0.9615(10)(^{+47}_{\ -3})(5)$, where the first, second, and third errors are statistical, systematic errors from choice of the fit forms and isospin breaking effect, respectively. Combining our value of $f_+(0)$ and experimental input of the $K_{\ell 3}$ decay, one of the Cabibbo-Kobayashi-Maskawa matrix elements $|V_{us}|$ is determined as $|V_{us}| = 0.2252(^{\ +5}_{-12})$, whose error contains the experimental one as well as that in the lattice calculation. This value is reasonably consistent with the ones determined from recent lattice QCD results of $f_+(0)$ and also the one determined through the kaon leptonic decay process. We observe some tension between our value and $|V_{us}|$ evaluated from the unitarity of the CKM matrix with $|V_{ud}|$, while it depends on the size of the error of $|V_{ud}|$. It is also found that $|V_{us}|$ determined with our phase space integrals through six $K_{\ell 3}$ decay processes is consistent with the above one using $f_+(0)$.


title: Learning Implicit Feature Alignment Function for Semantic Segmentation

abstract: Integrating high-level context information with low-level details is of central importance in semantic segmentation. Towards this end, most existing segmentation models apply bilinear up-sampling and convolutions to feature maps of different scales, and then align them at the same resolution. However, bilinear up-sampling blurs the precise information learned in these feature maps and convolutions incur extra computation costs. To address these issues, we propose the Implicit Feature Alignment function (IFA). Our method is inspired by the rapidly expanding topic of implicit neural representations, where coordinate-based neural networks are used to designate fields of signals. In IFA, feature vectors are viewed as representing a 2D field of information. Given a query coordinate, nearby feature vectors with their relative coordinates are taken from the multi-level feature maps and then fed into an MLP to generate the corresponding output. As such, IFA implicitly aligns the feature maps at different levels and is capable of producing segmentation maps in arbitrary resolutions. We demonstrate the efficacy of IFA on multiple datasets, including Cityscapes, PASCAL Context, and ADE20K. Our method can be combined with improvement on various architectures, and it achieves state-of-the-art computation-accuracy trade-off on common benchmarks. Code will be made available at https://github.com/hzhupku/IFA.


title: tinySNN: Towards Memory- and Energy-Efficient Spiking Neural Networks

abstract: Larger Spiking Neural Network (SNN) models are typically favorable as they can offer higher accuracy. However, employing such models on the resource- and energy-constrained embedded platforms is inefficient. Towards this, we present a tinySNN framework that optimizes the memory and energy requirements of SNN processing in both the training and inference phases, while keeping the accuracy high. It is achieved by reducing the SNN operations, improving the learning quality, quantizing the SNN parameters, and selecting the appropriate SNN model. Furthermore, our tinySNN quantizes different SNN parameters (i.e., weights and neuron parameters) to maximize the compression while exploring different combinations of quantization schemes, precision levels, and rounding schemes to find the model that provides acceptable accuracy. The experimental results demonstrate that our tinySNN significantly reduces the memory footprint and the energy consumption of SNNs without accuracy loss as compared to the baseline network. Therefore, our tinySNN effectively compresses the given SNN model to achieve high accuracy in a memory- and energy-efficient manner, hence enabling the employment of SNNs for the resource- and energy-constrained embedded applications.


title: BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning

abstract: Vision-Language (VL) models with the Two-Tower architecture have dominated visual-language representation learning in recent years. Current VL models either use lightweight uni-modal encoders and learn to extract, align and fuse both modalities simultaneously in a deep cross-modal encoder, or feed the last-layer uni-modal representations from the deep pre-trained uni-modal encoders into the top cross-modal encoder. Both approaches potentially restrict vision-language representation learning and limit model performance. In this paper, we propose BridgeTower, which introduces multiple bridge layers that build a connection between the top layers of uni-modal encoders and each layer of the cross-modal encoder. This enables effective bottom-up cross-modal alignment and fusion between visual and textual representations of different semantic levels of pre-trained uni-modal encoders in the cross-modal encoder. Pre-trained with only 4M images, BridgeTower achieves state-of-the-art performance on various downstream vision-language tasks. In particular, on the VQAv2 test-std set, BridgeTower achieves an accuracy of 78.73%, outperforming the previous state-of-the-art model METER by 1.09% with the same pre-training data and almost negligible additional parameters and computational costs. Notably, when further scaling the model, BridgeTower achieves an accuracy of 81.15%, surpassing models that are pre-trained on orders-of-magnitude larger datasets. Code and checkpoints are available at https://github.com/microsoft/BridgeTower.


title: Physics Informed Neural Networks for Two Dimensional Incompressible Thermal Convection Problems

abstract: Physics informed neural networks (PINNs) have drawn attention in recent years in engineering problems due to their effectiveness and ability to tackle the problems without generating complex meshes. PINNs use automatic differentiation to evaluate differential operators in conservation laws and hence do not need to have a discretization scheme. Using this ability, PINNs satisfy governing laws of physics in the loss function without any training data. In this work, we solve various incompressible thermal convection problems including real applications and problems with comparable numerical or analytical results. We first consider a channel problem with an analytical solution to show the accuracy of our network. Then, we solve a thermal convection problem in a closed enclosure in which the flow is only due to the temperature gradients on the boundaries. Lastly, we consider steady and unsteady partially blocked channel problems that resemble industrial applications to power electronics.


title: Digital Twin Data Modelling by Randomized Orthogonal Decomposition and Deep Learning

abstract: A digital twin is a surrogate model that has the main feature to mirror the original process behavior. Associating the dynamical process with a digital twin model of reduced complexity has the significant advantage to map the dynamics with high accuracy and reduced costs in CPU time and hardware to timescales over which that suffers significantly changes and so it is difficult to explore. This paper introduces a new framework for creating efficient digital twin models of fluid flows. We introduce a novel algorithm that combines the advantages of Krylov based dynamic mode decomposition with proper orthogonal decomposition and outperforms the selection of the most influential modes. We prove that randomized orthogonal decomposition algorithm provides several advantages over SVD empirical orthogonal decomposition methods and mitigates the projection error formulating a multiobjective optimization problem.We involve the state-of-the-art artificial intelligence Deep Learning (DL) to perform a real-time adaptive calibration of the digital twin model, with increasing fidelity. The output is a high-fidelity DIGITAL TWIN DATA MODEL of the fluid flow dynamics, with the advantage of a reduced complexity. The new modelling tools are investigated in the numerical simulation of three wave phenomena with increasing complexity. We show that the outputs are consistent with the original source data.We perform a thorough assessment of the performance of the new digital twin data models, in terms of numerical accuracy and computational efficiency, including a time simulation response feature study.


title: Efficient Raycasting of Volumetric Depth Images for Remote Visualization of Large Volumes at High Frame Rates

abstract: We present an efficient raycasting algorithm for rendering Volumetric Depth Images (VDIs), and we show how it can be used in a remote visualization setting with VDIs generated and streamed from a remote server. VDIs are compact view-dependent volume representations that enable interactive visualization of large volumes at high frame rates by decoupling viewpoint changes from expensive rendering calculations. However, current rendering approaches for VDIs struggle with achieving interactive frame rates at high image resolutions. Here, we exploit the properties of perspective projection to simplify intersections of rays with the view-dependent frustums in a VDI and leverage spatial smoothness in the volume data to minimize memory accesses. Benchmarks show that responsive frame rates can be achieved close to the viewpoint of generation for HD display resolutions, providing high-fidelity approximate renderings of Gigabyte-sized volumes. We also propose a method to subsample the VDI for preview rendering, maintaining high frame rates even for large viewpoint deviations. We provide our implementation as an extension of an established open-source visualization library.


title: Boosting Factorization Machines via Saliency-Guided Mixup

abstract: Factorization machines (FMs) are widely used in recommender systems due to their adaptability and ability to learn from sparse data. However, for the ubiquitous non-interactive features in sparse data, existing FMs can only estimate the parameters corresponding to these features via the inner product of their embeddings. Undeniably, they cannot learn the direct interactions of these features, which limits the model's expressive power. To this end, we first present MixFM, inspired by Mixup, to generate auxiliary training data to boost FMs. Unlike existing augmentation strategies that require labor costs and expertise to collect additional information such as position and fields, these extra data generated by MixFM only by the convex combination of the raw ones without any professional knowledge support. More importantly, if the parent samples to be mixed have non-interactive features, MixFM will establish their direct interactions. Second, considering that MixFM may generate redundant or even detrimental instances, we further put forward a novel Factorization Machine powered by Saliency-guided Mixup (denoted as SMFM). Guided by the customized saliency, SMFM can generate more informative neighbor data. Through theoretical analysis, we prove that the proposed methods minimize the upper bound of the generalization error, which hold a beneficial effect on enhancing FMs. Significantly, we give the first generalization bound of FM, implying the generalization requires more data and a smaller embedding size under the sufficient representation capability. Finally, extensive experiments on five datasets confirm that our approaches are superior to baselines. Besides, the results show that "poisoning" mixed data is likewise beneficial to the FM variants.


title: PICO: Pipeline Inference Framework for Versatile CNNs on Diverse Mobile Devices

abstract: Distributing the inference of convolutional neural network (CNN) to multiple mobile devices has been studied in recent years to achieve real-time inference without losing accuracy. However, how to map CNN to devices remains a challenge. On the one hand, scheduling the workload of state-of-the-art CNNs with multiple devices is NP-Hard because the structures of CNNs are directed acyclic graphs (DAG) rather than simple chains. On the other hand, distributing the inference workload suffers from expensive communication and unbalanced computation due to the wireless environment and heterogeneous devices. This paper presents PICO, a pipeline cooperation framework to accelerate the inference of versatile CNNs on diverse mobile devices. At its core, PICO features: (1) a generic graph partition algorithm that considers the characteristics of any given CNN and orchestrates it into a list of model pieces with suitable granularity, and (2) a many-to-many mapping algorithm that produces the best pipeline configuration for heterogeneous devices. In our experiment with 2 ~ 8 Raspberry-Pi devices, the throughput can be improved by 1.8 ~ 6.8x under different CPU frequencies.


title: A census of small Schurian association schemes

abstract: Using the classification of transitive groups of degree $n$, for $2 \leqslant n \leqslant 48$, we classify the Schurian association schemes of order $n$, and as a consequence, the transitive groups of degree $n$ that are $2$-closed. In addition, we compute the character table of each association scheme and provide a census of important properties. Finally, we compute the $2$-closure of each transitive group of degree $n$, for $2 \leqslant n \leqslant 48$. The results of this classification are made available as a supplementary database.


title: Strain and electric field control of magnetic and electrical transport properties in a magneto-elastically coupled Fe3O4/BaTiO3(001) heterostructure

abstract: We present a study of the control of electric field induced strain on the magnetic and electrical transport properties in a magneto-elastically coupled artificial multiferroic Fe3O4/BaTiO3 heterostructure. In this Fe3O4/BaTiO3 heterostructure, the Fe3O4 thin film is epitaxially grown in the form of bilateral domains, analogous to a-c stripe domains of the underlying BaTiO3(001) substrate. By in-situ electric field dependent magnetization measurements, we demonstrate the extrinsic control of the magnetic anisotropy and the characteristic Verwey metal-insulator transition of the epitaxial Fe3O4 thin film in a wide temperature range between 20-300 K, via strain mediated converse magnetoelectric coupling. In addition, we observe strain induced modulations in the magnetic and electrical transport properties of the Fe3O4 thin film across the thermally driven intrinsic ferroelectric and structural phase transitions of the BaTiO3 substrate. In-situ electric field dependent Raman measurements reveal that the electric field does not significantly modify the anti-phase boundary defects in the Fe3O4 thin film once it is thermodynamically stable after deposition and that the modification of the magnetic properties is mainly caused by strain induced lattice distortions and magnetic anisotropy. These results provide a framework to realize electrical control of the magnetization in a classical highly correlated transition metal oxide.


title: The infinite dihedral group

abstract: We describe the infinite dihedral group as automaton group. We collect basic results and give full proofs in details for all statements.


title: The Sensorium competition on predicting large-scale mouse primary visual cortex activity

abstract: The neural underpinning of the biological visual system is challenging to study experimentally, in particular as the neuronal activity becomes increasingly nonlinear with respect to visual input. Artificial neural networks (ANNs) can serve a variety of goals for improving our understanding of this complex system, not only serving as predictive digital twins of sensory cortex for novel hypothesis generation in silico, but also incorporating bio-inspired architectural motifs to progressively bridge the gap between biological and machine vision. The mouse has recently emerged as a popular model system to study visual information processing, but no standardized large-scale benchmark to identify state-of-the-art models of the mouse visual system has been established. To fill this gap, we propose the Sensorium benchmark competition. We collected a large-scale dataset from mouse primary visual cortex containing the responses of more than 28,000 neurons across seven mice stimulated with thousands of natural images, together with simultaneous behavioral measurements that include running speed, pupil dilation, and eye movements. The benchmark challenge will rank models based on predictive performance for neuronal responses on a held-out test set, and includes two tracks for model input limited to either stimulus only (Sensorium) or stimulus plus behavior (Sensorium+). We provide a starting kit to lower the barrier for entry, including tutorials, pre-trained baseline models, and APIs with one line commands for data loading and submission. We would like to see this as a starting point for regular challenges and data releases, and as a standard tool for measuring progress in large-scale neural system identification models of the mouse visual system and beyond.


title: A Maupertuis-type principle in relativistic mechanics and applications

abstract: We provide a Maupertuis-type principle for the following system of ODE, of interest in special relativity: $$ \frac{\rm d}{{\rm d}t}\left(\frac{m\dot{x}}{\sqrt{1-|\dot{x}|^2/c^2}}\right)=\nabla V(x),\qquad x\in\Omega \subset \mathbb{R}^n, $$ where $m, c > 0$ and $V: \Omega \to \mathbb{R}$ is a function of class $C^1$. As an application, we prove the existence of multiple periodic solutions with prescribed energy for a relativistic $N$-centre type problem in the plane.


title: A characterization of multiplier ideals via ultraproducts

abstract: In this paper, using ultra-Frobenii, we introduce a variant of Schoutens' non-standard tight closure, ultra-tight closure, on ideals of a local domain $R$ essentially of finite type over $\mathbb{C}$. We prove that the ultra-test ideal $\tau_{\rm u}(R,\mathfrak{a}^t)$, the annihilator ideal of all ultra-tight closure relations of $R$, coincides with the multiplier ideal $\mathcal{J}(\operatorname{Spec} R,\mathfrak{a}^t)$ if $R$ is normal $\mathbb{Q}$-Gorenstein. As an application, we study a behavior of multiplier ideals under pure ring extensions.


title: VG-Swarm: A Vision-based Gene Regulation Network for UAVs Swarm Behavior Emergence

abstract: Unmanned Aerial Vehicles (UAVs) dynamic encirclement is an emerging field with great potential. Researchers often get inspiration from biological systems, either from macro-world like fish schools or bird flocks etc, or from micro-world like gene regulatory networks (GRN). However, most swarm control algorithms rely on centralized control, global information acquisition, and communications among neighboring agents. In this work, we propose a distributed swarm control method based purely on vision and GRN without any direct communications, in which swarm agents of e.g. UAVs can generate an entrapping pattern to encircle an escaping target of UAV based purely on their installed omnidirectional vision sensors. A finite-state-machine (FSM) describing the behavioral model of each drone is also designed so that a swarm of drones can accomplish searching and entrapping of the target collectively in an integrated way. We verify the effectiveness and efficiency of the proposed method in various simulation and real-world experiments.


title: Magnesium-vacancy optical centers in diamond

abstract: We provide the first systematic characterization of the structural and photoluminescence properties of optically active defect centers fabricated upon implantation of 30-100 keV Mg+ ions in artificial diamond. The structural configurations of Mg-related defects were studied by the emission channeling technique for 27Mg implantations performed both at room-temperature and 800 {\deg}C, which allowed the identification of a major fraction of Mg atoms (~30-42%) in sites which are compatible with the split-vacancy structure of the MgV complex. A smaller fraction of Mg atoms (~13-17%) was found on substitutional sites. The photoluminescence emission was investigated both at the ensemble and individual defect level in a temperature range comprised between 5 K and 300 K, offering a detailed picture of the MgV-related emission properties and revealing the occurrence of previously unreported spectral features. The optical excitability of the MgV center was also studied as a function of the optical excitation wavelength enabling to identify the optimal conditions for photostable and intense emission. The results are discussed in the context of the preliminary experimental data and the theoretical models available in the literature, with appealing perspectives for the utilization of the tunable properties of the MgV center for quantum information processing applications.


title: FiT: Parameter Efficient Few-shot Transfer Learning for Personalized and Federated Image Classification

abstract: Modern deep learning systems are increasingly deployed in situations such as personalization and federated learning where it is necessary to support i) learning on small amounts of data, and ii) communication efficient distributed training protocols. In this work, we develop FiLM Transfer (FiT) which fulfills these requirements in the image classification setting by combining ideas from transfer learning (fixed pretrained backbones and fine-tuned FiLM adapter layers) and meta-learning (automatically configured Naive Bayes classifiers and episodic training) to yield parameter efficient models with superior classification accuracy at low-shot. The resulting parameter efficiency is key for enabling few-shot learning, inexpensive model updates for personalization, and communication efficient federated learning. We experiment with FiT on a wide range of downstream datasets and show that it achieves better classification accuracy than the leading Big Transfer (BiT) algorithm at low-shot and achieves state-of-the art accuracy on the challenging VTAB-1k benchmark, with fewer than 1% of the updateable parameters. Finally, we demonstrate the parameter efficiency and superior accuracy of FiT in distributed low-shot applications including model personalization and federated learning where model update size is an important performance metric.


title: A Deep Learning Approach for the Segmentation of Electroencephalography Data in Eye Tracking Applications

abstract: The collection of eye gaze information provides a window into many critical aspects of human cognition, health and behaviour. Additionally, many neuroscientific studies complement the behavioural information gained from eye tracking with the high temporal resolution and neurophysiological markers provided by electroencephalography (EEG). One of the essential eye-tracking software processing steps is the segmentation of the continuous data stream into events relevant to eye-tracking applications, such as saccades, fixations, and blinks. Here, we introduce DETRtime, a novel framework for time-series segmentation that creates ocular event detectors that do not require additionally recorded eye-tracking modality and rely solely on EEG data. Our end-to-end deep learning-based framework brings recent advances in Computer Vision to the forefront of the times series segmentation of EEG data. DETRtime achieves state-of-the-art performance in ocular event detection across diverse eye-tracking experiment paradigms. In addition to that, we provide evidence that our model generalizes well in the task of EEG sleep stage segmentation.


title: A Quantitative and Qualitative Analysis of Suicide Ideation Detection using Deep Learning

abstract: For preventing youth suicide, social media platforms have received much attention from researchers. A few researches apply machine learning, or deep learning-based text classification approaches to classify social media posts containing suicidality risk. This paper replicated competitive social media-based suicidality detection/prediction models. We evaluated the feasibility of detecting suicidal ideation using multiple datasets and different state-of-the-art deep learning models, RNN-, CNN-, and Attention-based models. Using two suicidality evaluation datasets, we evaluated 28 combinations of 7 input embeddings with 4 commonly used deep learning models and 5 pretrained language models in quantitative and qualitative ways. Our replication study confirms that deep learning works well for social media-based suicidality detection in general, but it highly depends on the dataset's quality.


title: The Kinetic Energy of PAH Dication and Trication Dissociation Determined by Recoil-Frame Covariance Map Imaging

abstract: We investigated the dissociation of dications and trications of three polycyclic aromatic hydrocarbons (PAHs), fluorene, phenanthrene, and pyrene. PAHs are a family of molecules ubiquitous in space and involved in much of the chemistry of the interstellar medium. In our experiments, ions are formed by interaction with 30.3 nm extreme ultraviolet (XUV) photons, and their velocity map images are recorded using a PImMS2 multi-mass imaging sensor. Application of recoil-frame covariance analysis allows the total kinetic energy release (TKER) associated with multiple fragmentation channels to be determined to high precision, ranging 1.94-2.60 eV and 2.95-5.29 eV for the dications and trications, respectively. Experimental measurements are supported by Born-Oppenheimer molecular dynamics (BOMD) simulations.


title: Understanding Robust Overfitting of Adversarial Training and Beyond

abstract: Robust overfitting widely exists in adversarial training of deep networks. The exact underlying reasons for this are still not completely understood. Here, we explore the causes of robust overfitting by comparing the data distribution of \emph{non-overfit} (weak adversary) and \emph{overfitted} (strong adversary) adversarial training, and observe that the distribution of the adversarial data generated by weak adversary mainly contain small-loss data. However, the adversarial data generated by strong adversary is more diversely distributed on the large-loss data and the small-loss data. Given these observations, we further designed data ablation adversarial training and identify that some small-loss data which are not worthy of the adversary strength cause robust overfitting in the strong adversary mode. To relieve this issue, we propose \emph{minimum loss constrained adversarial training} (MLCAT): in a minibatch, we learn large-loss data as usual, and adopt additional measures to increase the loss of the small-loss data. Technically, MLCAT hinders data fitting when they become easy to learn to prevent robust overfitting; philosophically, MLCAT reflects the spirit of turning waste into treasure and making the best use of each adversarial data; algorithmically, we designed two realizations of MLCAT, and extensive experiments demonstrate that MLCAT can eliminate robust overfitting and further boost adversarial robustness.


title: Time projection chambers for gamma-ray astronomy

abstract: The detection of photons with energies greater than a few tenths of an MeV, interacting via Compton scattering and/or pair production, faces a number of difficulties. The reconstruction of single-scatter Compton events can only determine the direction of the incoming photon to a cone, or an arc thereof and the angular resolution of pair-conversion telescopes is badly degraded at low energies. Both of these difficulties are partially overcome if the density of the interaction medium is low. Also no precise polarization measurement on a cosmic source has been obtained in that energy range to date. We present the potential of low-density high-precision homogeneous active targets, such as time-projection chambers (TPC) to provide an unambiguous photon direction measurement for Compton events, an angular resolution down to the kinematic limit for pair events, and the polarimetry of linearly polarized radiation.


title: Slow-Roll Inflation in the Jordan Frame

abstract: Inflation models based on scalar-tensor theories of gravity are formulated in the Jordan frame but most often analysed in the Einstein frame. The transformation between the frames is not always desirable. In this work we formulate slow-roll conditions in the Jordan frame. This is achieved by comparing different background quantities and approximations on the same spatial slice in both frames. We use these approximations to derive simple equations that can be applied to compute inflation model observables in terms of Jordan frame quantities only. Finally, we apply some of the results to analyse generalised induced gravity models and compare them with the latest observations.


title: Clustering of emission line galaxies with IllustrisTNG I.: fundamental properties and halo occupation distribution

abstract: Upcoming spectroscopic redshift surveys use emission line galaxies (ELGs) to trace the three-dimensional matter distributions with wider area coverage in the deeper Universe. Since the halos hosting ELGs are young and undergo infall towards more massive halos along filamentary structures, contrary to a widely employed luminous red galaxy sample, the dynamics specific to ELGs should be taken into account to refine the theoretical modelling at non-linear scales. In this paper, we scrutinise the halo occupation distribution (HOD) and clustering properties of ELGs by utilising IllustrisTNG galaxy formation hydrodynamical simulations. Leveraging stellar population synthesis technique coupled with the photo-ionization model, we compute line intensities of simulated galaxies and construct mock H$\alpha$ and [OII] ELG catalogues. The line luminosity functions and the relation between the star formation rate and line intensity are well consistent with observational estimates. Next, we measure the HOD and demonstrate that there is a distinct population for the central HOD, which corresponds to low-mass infalling halos. We then perform the statistical inference of HOD parameters from the projected correlation function. Our analysis indicates that the inferred HODs significantly deviate from the HOD measured directly from simulations although the best-fit model yields a good fit to the projected correlation function. It implies that the information content of the projected correlation function is not adequate to constrain HOD models correctly and thus, it is important to employ mock ELG catalogues to calibrate the functional form of HOD models and add prior information on HOD parameters to robustly determine the HOD.


title: Wrapping corrections for long range spin chains

abstract: The long range spin chains play an important role in the gauge/string duality. The aim of this paper is to generalize the recently introduced transfer matrices of integrable medium range spin chains to long range models. These transfer matrices define a large set of conserved charges for every length of the spin chain. These charges agree with the original definition of long range spin chains for infinite length. However, our construction works for every length, providing the definition of integrable finite size long range spin chains whose spectrum already contains the wrapping corrections.


title: BITS Pilani at HinglishEval: Quality Evaluation for Code-Mixed Hinglish Text Using Transformers

abstract: Code-Mixed text data consists of sentences having words or phrases from more than one language. Most multi-lingual communities worldwide communicate using multiple languages, with English usually one of them. Hinglish is a Code-Mixed text composed of Hindi and English but written in Roman script. This paper aims to determine the factors influencing the quality of Code-Mixed text data generated by the system. For the HinglishEval task, the proposed model uses multi-lingual BERT to find the similarity between synthetically generated and human-generated sentences to predict the quality of synthetically generated Hinglish sentences.


title: Influence of the surface states on the nonlinear Hall effect in Weyl semimetals

abstract: We investigate the influence of surface states on the nonlinear Hall response of non-centrosymmetric time-reversal invariant Weyl semimetals. To do so, we perform a tomography of the Berry curvature dipole in a slab system using a minimal two-band model. We find that in the type-I phase, the nonlinear Hall response is not particularly sensitive to the presence of Fermi arcs or other trivial surface states. However, in the type-II phase, we find that these surface states contribute substantially to the Berry curvature dipole, leading to a strong thickness dependence of the nonlinear Hall response. This feature depends on the nature of the surface states and, henceforth, on the slab geometry adopted. In order to assess the validity of this scenario for realistic systems, we performed Berry curvature dipole calculations by first principles on the WTe$_2$, confirming the dramatic impact of surface states for selected slab geometries. Our results suggest that surface states, being topological or not, can contribute much more efficiently to the nonlinear Hall response than bulk states. This prediction is not limited to topological semimetals and should apply to topologically trivial non-centrosymmetric materials and heterostructures, paving the way to interfacial engineering of the nonlinear Hall effect.


title: Spectral inequality with sensor sets of decaying density for Schr\"odinger operators with power growth potentials

abstract: We prove a spectral inequality (a specific type of uncertainty relation) for Schr\"odinger operators with confinement potentials, in particular of Shubin-type. The sensor sets are allowed to decay exponentially, where the precise allowed decay rate depends on the potential. The proof uses an interpolation inequality derived by Carleman estimates, quantitative weighted $L^2$-estimates and an $H^1$-concentration estimate, all of them for functions in a spectral subspace of the operator.


title: AggNet: Learning to Aggregate Faces for Group Membership Verification

abstract: In some face recognition applications, we are interested to verify whether an individual is a member of a group, without revealing their identity. Some existing methods, propose a mechanism for quantizing precomputed face descriptors into discrete embeddings and aggregating them into one group representation. However, this mechanism is only optimized for a given closed set of individuals and needs to learn the group representations from scratch every time the groups are changed. In this paper, we propose a deep architecture that jointly learns face descriptors and the aggregation mechanism for better end-to-end performances. The system can be applied to new groups with individuals never seen before and the scheme easily manages new memberships or membership endings. We show through experiments on multiple large-scale wild-face datasets, that the proposed method leads to higher verification performance compared to other baselines.


title: Sparse Double Descent: Where Network Pruning Aggravates Overfitting

abstract: People usually believe that network pruning not only reduces the computational cost of deep networks, but also prevents overfitting by decreasing model capacity. However, our work surprisingly discovers that network pruning sometimes even aggravates overfitting. We report an unexpected sparse double descent phenomenon that, as we increase model sparsity via network pruning, test performance first gets worse (due to overfitting), then gets better (due to relieved overfitting), and gets worse at last (due to forgetting useful information). While recent studies focused on the deep double descent with respect to model overparameterization, they failed to recognize that sparsity may also cause double descent. In this paper, we have three main contributions. First, we report the novel sparse double descent phenomenon through extensive experiments. Second, for this phenomenon, we propose a novel learning distance interpretation that the curve of $\ell_{2}$ learning distance of sparse models (from initialized parameters to final parameters) may correlate with the sparse double descent curve well and reflect generalization better than minima flatness. Third, in the context of sparse double descent, a winning ticket in the lottery ticket hypothesis surprisingly may not always win.


title: Optimal solvability for the fractional p-Laplacian with Dirichlet conditions

abstract: We study a nonlinear, nonlocal Dirichlet problem driven by the fractional p-Laplacian, involving a (p-1)-sublinear reaction. By means of a weak comparison principle we prove uniqueness of the solution. Also, comparing the problem to 'asymptotic' weighted eigenvalue problems for the same operator, we prove a necessary and sufficient condition for the existence of a solution. Our work extends classical results due to Brezis-Oswald and Diaz-Saa to the quasilinear nonlocal framework.


title: Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learning

abstract: Achieving human-level dexterity is an important open problem in robotics. However, tasks of dexterous hand manipulation, even at the baby level, are challenging to solve through reinforcement learning (RL). The difficulty lies in the high degrees of freedom and the required cooperation among heterogeneous agents (e.g., joints of fingers). In this study, we propose the Bimanual Dexterous Hands Benchmark (Bi-DexHands), a simulator that involves two dexterous hands with tens of bimanual manipulation tasks and thousands of target objects. Specifically, tasks in Bi-DexHands are designed to match different levels of human motor skills according to cognitive science literature. We built Bi-DexHands in the Issac Gym; this enables highly efficient RL training, reaching 30,000+ FPS by only one single NVIDIA RTX 3090. We provide a comprehensive benchmark for popular RL algorithms under different settings; this includes Single-agent/Multi-agent RL, Offline RL, Multi-task RL, and Meta RL. Our results show that the PPO type of on-policy algorithms can master simple manipulation tasks that are equivalent up to 48-month human babies (e.g., catching a flying object, opening a bottle), while multi-agent RL can further help to master manipulations that require skilled bimanual cooperation (e.g., lifting a pot, stacking blocks). Despite the success on each single task, when it comes to acquiring multiple manipulation skills, existing RL algorithms fail to work in most of the multi-task and the few-shot learning settings, which calls for more substantial development from the RL community. Our project is open sourced at https://github.com/PKU-MARL/DexterousHands.


title: You Only Derive Once (YODO): Automatic Differentiation for Efficient Sensitivity Analysis in Bayesian Networks

abstract: Sensitivity analysis measures the influence of a Bayesian network's parameters on a quantity of interest defined by the network, such as the probability of a variable taking a specific value. In particular, the so-called sensitivity value measures the quantity of interest's partial derivative with respect to the network's conditional probabilities. However, finding such values in large networks with thousands of parameters can become computationally very expensive. We propose to use automatic differentiation combined with exact inference to obtain all sensitivity values in a single pass. Our method first marginalizes the whole network once using e.g. variable elimination and then backpropagates this operation to obtain the gradient with respect to all input parameters. We demonstrate our routines by ranking all parameters by importance on a Bayesian network modeling humanitarian crises and disasters, and then show the method's efficiency by scaling it to huge networks with up to 100'000 parameters. An implementation of the methods using the popular machine learning library PyTorch is freely available.


title: Detecting Connectivity Issues in Android Apps

abstract: Android is the most popular mobile operating system in the world, running on more than 70% of mobile devices. This implies a gigantic and very competitive market for Android apps. Being successful in such a market is far from trivial and requires, besides the tackling of a problem or need felt by a vast audience, the development of high-quality apps. As recently showed in the literature, connectivity issues (e.g., mishandling of zero/unreliable Internet connection) can result in bugs and/or crashes, negatively affecting the app's user experience. While these issues have been studied in the literature, there are no techniques able to automatically detect and report them to developers. We present CONAN, a tool able to detect statically 16 types of connectivity issues affecting Android apps. We assessed the ability of CONAN to precisely identify these issues in a set of 44 open source apps, observing an average precision of 80%. Then, we studied the relevance of these issues for developers by (i) conducting interviews with six practitioners working with commercial Android apps, and (ii) submitting 84 issue reports for 27 open source apps. Our results show that several of the identified connectivity issues are considered as relevant by practitioners in specific contexts, in which connectivity is considered a first-class feature.


title: Hyperverse, 5-dimensional gravity and multiverses as nested Gogberashvili shells

abstract: We consider the Hyperverse as a collection of multiverses in 5-dimensional spacetime with gravitational constant $G$. Each multiverse in our simplified model is a bouquet of nested spherical Gogberashvili shells. If $g_k$ is the gravitational constant of a thin shell $S_k$ and $\varepsilon_k^{}$ its thickness then $G\sim\varepsilon_k^{}g_k^{}$. The physical universe is supposed to be one of those shells inside the local nested bouquet called Local Multiverse. We relate this construction to Robinson-Trautman metrics describing expanding spacetimes with spherical gravitational waves. Supermassive astronomical black holes, located at cores of elliptic/spiral galaxies, are also conjecturally described within this theory. Our constructions are equally consistent with the modern theory of cosmological coupling.


title: Laser-induced electron dynamics and surface modification in ruthenium thin films

abstract: We performed the experimental and theoretical study of the heating and damaging of ruthenium thin films induced by femtosecond laser irradiation. Results of an optical pump-probe thermoreflectance experiment with rotating sample allowing to significantly reduce heat accumulation in irradiated spot are presented. We show the evolution of surface morphology from growth of a heat-induced oxide layer at low and intermediate laser fluences to cracking and grooving at high fluences. Theoretical analysis of pump-probe signal allows us to relate behavior of hot electrons in ruthenium to the Fermi smearing mechanism. The analysis of heating is performed with the two-temperature modeling and molecular dynamics simulation, results of which demonstrate that the calculated melting threshold is higher than experimental damage threshold. We attribute it to heat-induced surface stresses leading to cracking which accumulates to more severe damage morphology. Our results provide an upper limit for operational conditions for ruthenium optics and also direct to further studies of the Fermi smearing mechanism in other transition metals.


title: Bubble nucleation and quantum initial conditions in classical statistical simulations

abstract: Classical-statistical lattice simulations provide a useful approximation to out-of-equilibrium quantum field theory, but only for systems exhibiting large occupation numbers, and only for phenomena that are not intrinsically quantum mechanical in nature. In certain special circumstances, it can be appropriate to initialize such real-time simulations with quantum-like zero-point fluctuations. We will revisit these points, and investigate reports that quantum bubble nucleation rates in 1+1 dimensions can be computed through the classical evolution of such a quantum-like initial condition. We find that although intriguing, the reported numerical agreement between classical-statistical simulations and the quantum nucleation rate in 1+1 dimensions is a coincidence, which is not specific to this choice of initialisation, is parameter and lattice cut-off dependent and disappears as the number of space-dimensions increases from 1+1 to 2+1


title: Distinct impacts of polar and nematic self-propulsion on active unjamming

abstract: Though jamming transitions are long studied in condensed matter physics and granular systems, much less is known about active jamming (or unjamming), which commonly takes place in living materials. In this paper, we explore, by molecular dynamic simulations, the jamming-unjamming transition in a dense system of active semi-flexible filaments. In particular we characterise the distinct impact of polar versus nematic driving for different filament rigidity and at varying density. Our results show that high densities of dynamic active filaments can be achieved by only changing the nature of the active force, nematic or polar. Interestingly, while polar driving is more effective at unjamming the system at high densities below confluency, we find that at even higher densities nematic driving enhances unjamming compared to its polar counterpart. The effect of varying the rigidity of filaments is also significantly different in the two cases: while for nematic driving lowering bending rigidity unjams the system, we find an intriguing re-entrant jamming-unjamming-jamming transition for polar driving as the filament rigidity is lowered. While the first transition (unjamming) is driven by softening due to reduced rigidity, the second transition (jamming) is a cooperative effect of ordering and coincides with the emergence of nematic order in the system. Together, through a generic model of self-propelled flexible filaments, our results demonstrate how tuning the nature of self-propulsion and flexibility can be employed by active materials to achieve high densities without getting jammed.


title: Slow electron elastic scattering by a target represented by different zero-range potentials

abstract: The general formulas to calculate the phase shifts of wave function of a particle scattering on a target formed by a pair of non-identical zero-range potentials are derived. It is shown that at asymptotically great distances from the target the continuum wave function of particle is presented as an expansion in a set of other than spherical, orthonormal functions. General formulas for these functions are obtained. The special features of the S-matrix method for the case of arbitrary non-spherical potentials are discussed.


title: Regular black holes with improved energy conditions and their analogues in fluids

abstract: On the premise of the importance of energy conditions for regular black holes, we propose a method to remedy those models that break the dominant energy condition, e.g., the Bardeen and Hayward black holes. We modify the metrics but ensure their regularity at the same time, so that the weak, null, and dominant energy conditions are satisfied, with the exception of the strong energy condition. Likewise, we prove a no-go theorem for conformally related regular black holes, which states that the four energy conditions can never be met in this class of black holes. In order to seek evidences for distinguishing regular black holes from singular black holes, we resort to analogue gravity and regard it as a tool to mimic realistic regular black holes in a fluid. The equations of state for the fluid are solved via an asymptotic analysis associated with a numerical method, which provides a modus operandi for experimental observations, in particular, the conditions under which one can simulate realistic regular black holes in the fluid.


title: Time dynamics of multi-photon scattering in a two-level mixer

abstract: A superconducting qubit in a waveguide behaves as a point-like nonlinear element. If irradiated with nearly resonant microwave pulses, the qubit undergoes quantum evolution and generates coherent fields at sideband frequencies due to elastic scattering. This effect is called Quantum Wave Mixing (QWM), and the number of emerged side components depends on the number of interacting photons. By driving a superconducting qubit with short pulses with alternating carrier frequencies, we control the maximal number of photons simultaneously interacting with a two-level system by varying the number and duration of applied pulses. Increasing the number of pulses results in consecutive growth of the order of non-linearity, which manifests in additional coherent side peaks appearing in the spectrum of scattered radiation while the whole spectrum maintains its asymmetry.


title: A novel design of industrial real-time CT system based on sparse-view reconstruction and deep-learning image enhancement

abstract: Industrial CT is useful for defect detection, dimensional inspection and geometric analysis. While it does not meet the needs of industrial mass production, because of its time-consuming imaging procedure. This article proposes a novel stationary real-time CT system with multiple X-ray sources and detectors, which is able to refresh the CT reconstructed slices to the detector frame frequency. This kind of structure avoids the movement of the X-ray sources and detectors. Projections from different angles can be acquired with the objects' translation, which makes it easier to be integrated into pipeline. All the detectors are arranged along the conveyor, and observe the objects in different angle of view. With the translation of objects, their X-ray projections are obtained for CT reconstruction. To decrease the mechanical size and reduce the number of X-ray sources and detectors, the FBP reconstruction algorithm was combined with deep-learning image enhancement. Medical CT images were applied to train the deep-learning network for its quantity advantage in comparison with industrial ones. It is the first time to adopt this source-detector layout strategy. Data augmentation and regularization were used to elevate the generalization of the network. Time consumption of the CT imaging process was also calculated to prove its high efficiency. It is an innovative design for the 4th industrial revolution, providing an intelligent quality inspection solution for digital production.


title: Reviewer Preferences and Gender Disparities in Aesthetic Judgments

abstract: Aesthetic preferences are considered highly subjective resulting in inherently noisy judgements of aesthetic objects, yet certain aspects of aesthetic judgement display convergent trends over time. This paper present a study that uses literary reviews as a proxy for aesthetic judgement in order to identify systematic components that can be attributed to bias. Specifically we find that judgement of literary quality in newspapers displays a gender bias in preference of male writers. Male reviewers have a same gender preference while female reviewer show an opposite gender preference. While alternative accounts exist of this apparent gender disparity, we argue that it reflects a cultural gender antagonism.


title: Towards computing complete parameter ranges in parametric modeling

abstract: In parametric design, the geometric model is edited by changing relevant parameters in the parametric model, which is commonly done sequentially on multiple parameters. Without guidance on allowable parameter ranges that can guarantee the solvability of the geometric constraint system, the user could assign improper parameter values to the model's parameters, which would further lead to a failure in model updating. However, current commercial CAD systems provide little support for the proper parameter assignments. Although the existing methods can compute allowable ranges for individual parameters, they face difficulties in handling multi-parameter situations. In particular, these methods could miss some feasible parameter values and provide incomplete allowable parameter ranges. To solve this problem, an automatic approach is proposed in this paper to compute complete parameter ranges in multi-parameter editing. In the approach, a set of variable parameters are first selected to be sequentially edited by the user; before each editing operation, the one-dimensional ranges of the variable parameters are presented as guidance. To compute the one-dimensional ranges, each variable parameter is expressed as an equality-constrained function, and its one-dimensional allowable range is obtained by calculating the function range. To effectively obtain the function range which can hardly be calculated in a normal way, the function range problem is converted into a constrained optimization problem, and is then solved by Lagrange multiplier method and the Niching particle swarm optimization algorithm (the NichePSO). The effectiveness and efficiency of the proposed approach is verified by several experimental results.


title: Study of entropy production due to electroweak phase transition in $Z_2$ symmetric extension of the Standard Model

abstract: In this work we consider the simple $Z_2$ symmetric extension to the Standard Model (SM) and proceed to study the nature of electroweak phase transition (EWPT) in the early universe. We show that the nature of the phase transition changes from a smooth crossover in the SM to a strong first order with this addition of the real scalar. Furthermore, we show the entropy release in this scenario is higher than that of the SM. This can lead to a strong dilution of frozen out dark matter particles and baryon asymmetry, if something existed before the onset of the phase transition.


title: Cyclic changes of the photospheric magnetic field polarity

abstract: The distribution of magnetic fields of positive and negative polarities over the surface of the Sun was studied. Synoptic maps of the photospheric magnetic field (NSO Kitt Peak, 1978--2016) were used for the analysis. In the time-latitude diagram for weak magnetic fields ($B \leq 5 G$), inclined bands are clearly visible, indicating the alternating dominance of magnetic fields with positive or negative polarity drifting towards the poles of the Sun. Analysis of the time-latitude diagram using the method of empirical orthogonal functions (EOF) made it possible to establish a cyclic change in the polarity of magnetic field flows with a period of 1-3 years, which indicates a possible connection with quasi biennial variation. Similar period values are obtained by averaging over the latitude of the time-latitude diagram


title: Towards Real-Time Visual Tracking with Graded Color-names Features

abstract: MeanShift algorithm has been widely used in tracking tasks because of its simplicity and efficiency. However, the traditional MeanShift algorithm needs to label the initial region of the target, which reduces the applicability of the algorithm. Furthermore, it is only applicable to the scene with a large overlap rate between the target area and the candidate area. Therefore, when the target speed is fast, the target scale change, shape deformation or the target occlusion occurs, the tracking performance will be deteriorated. In this paper, we address the challenges above-mentioned by developing a tracking method that combines the background models and the graded features of color-names under the MeanShift framework. This method significantly improve performance in the above scenarios. In addition, it facilitates the balance between detection accuracy and detection speed. Experimental results demonstrate the validation of the proposed method.


title: Sheaf Neural Networks with Connection Laplacians

abstract: A Sheaf Neural Network (SNN) is a type of Graph Neural Network (GNN) that operates on a sheaf, an object that equips a graph with vector spaces over its nodes and edges and linear maps between these spaces. SNNs have been shown to have useful theoretical properties that help tackle issues arising from heterophily and over-smoothing. One complication intrinsic to these models is finding a good sheaf for the task to be solved. Previous works proposed two diametrically opposed approaches: manually constructing the sheaf based on domain knowledge and learning the sheaf end-to-end using gradient-based methods. However, domain knowledge is often insufficient, while learning a sheaf could lead to overfitting and significant computational overhead. In this work, we propose a novel way of computing sheaves drawing inspiration from Riemannian geometry: we leverage the manifold assumption to compute manifold-and-graph-aware orthogonal maps, which optimally align the tangent spaces of neighbouring data points. We show that this approach achieves promising results with less computational overhead when compared to previous SNN models. Overall, this work provides an interesting connection between algebraic topology and differential geometry, and we hope that it will spark future research in this direction.


title: Plotly-Resampler: Effective Visual Analytics for Large Time Series

abstract: Visual analytics is arguably the most important step in getting acquainted with your data. This is especially the case for time series, as this data type is hard to describe and cannot be fully understood when using for example summary statistics. To realize effective time series visualization, four requirements have to be met; a tool should be (1) interactive, (2) scalable to millions of data points, (3) integrable in conventional data science environments, and (4) highly configurable. We observe that open source Python visualization toolkits empower data scientists in most visual analytics tasks, but lack the combination of scalability and interactivity to realize effective time series visualization. As a means to facilitate these requirements, we created Plotly-Resampler, an open source Python library. Plotly-Resampler is an add-on for Plotly's Python bindings, enhancing line chart scalability on top of an interactive toolkit by aggregating the underlying data depending on the current graph view. Plotly-Resampler is built to be snappy, as the reactivity of a tool qualitatively affects how analysts visually explore and analyze data. A benchmark task highlights how our toolkit scales better than alternatives in terms of number of samples and time series. Additionally, Plotly-Resampler's flexible data aggregation functionality paves the path towards researching novel aggregation techniques. Plotly-Resampler's integrability, together with its configurability, convenience, and high scalability, allows to effectively analyze high-frequency data in your day-to-day Python environment.


title: Maximum Class Separation as Inductive Bias in One Matrix

abstract: Maximizing the separation between classes constitutes a well-known inductive bias in machine learning and a pillar of many traditional algorithms. By default, deep networks are not equipped with this inductive bias and therefore many alternative solutions have been proposed through differential optimization. Current approaches tend to optimize classification and separation jointly: aligning inputs with class vectors and separating class vectors angularly. This paper proposes a simple alternative: encoding maximum separation as an inductive bias in the network by adding one fixed matrix multiplication before computing the softmax activations. The main observation behind our approach is that separation does not require optimization but can be solved in closed-form prior to training and plugged into a network. We outline a recursive approach to obtain the matrix consisting of maximally separable vectors for any number of classes, which can be added with negligible engineering effort and computational overhead. Despite its simple nature, this one matrix multiplication provides real impact. We show that our proposal directly boosts classification, long-tailed recognition, out-of-distribution detection, and open-set recognition, from CIFAR to ImageNet. We find empirically that maximum separation works best as a fixed bias; making the matrix learnable adds nothing to the performance. The closed-form implementation and code to reproduce the experiments are available on github.


title: Explainability's Gain is Optimality's Loss? -- How Explanations Bias Decision-making

abstract: Decisions in organizations are about evaluating alternatives and choosing the one that would best serve organizational goals. To the extent that the evaluation of alternatives could be formulated as a predictive task with appropriate metrics, machine learning algorithms are increasingly being used to improve the efficiency of the process. Explanations help to facilitate communication between the algorithm and the human decision-maker, making it easier for the latter to interpret and make decisions on the basis of predictions by the former. Feature-based explanations' semantics of causal models, however, induce leakage from the decision-maker's prior beliefs. Our findings from a field experiment demonstrate empirically how this leads to confirmation bias and disparate impact on the decision-maker's confidence in the predictions. Such differences can lead to sub-optimal and biased decision outcomes.


title: Structure Preserving $H_\infty$ Control for Port-Hamiltonian Systems

abstract: We study $H_\infty$ control design for linear time-invariant port-Hamiltonian systems. By a modification of the two central algebraic Riccati equations, we ensure that the resulting controller will be port-Hamiltonian. Using these modified equations, we proceed to show that a corresponding balanced truncation approach preserves port-Hamiltonian structure. We illustrate the theoretical findings using numerical examples and observe that the chosen representation of the port-Hamiltonian system can have an influence on the approximation qualities of the reduced order model.


title: Environment-Aware Hybrid Beamforming by Leveraging Channel Knowledge Map

abstract: Hybrid analog/digital beamforming is a promising technique to realize millimeter wave (mmWave) massive multiple-input multiple-output (MIMO) systems cost-effectively. However, existing hybrid beamforming designs mainly rely on real-time channel training or beam sweeping to find the desired beams, which incurs prohibitive overhead due to a large number of antennas at both the transmitter and receiver with only limited radio frequency (RF) chains. To resolve this challenging issue, in this paper, we propose a new environment-aware hybrid beamforming technique that requires only light real-time training, by leveraging the useful tool of channel knowledge map (CKM) with the user's location information. CKM is a site-specific database, which offers location-specific channel-relevant information to facilitate or even obviate the acquisition of real-time channel state information (CSI). Two specific types of CKM are proposed in this paper for hybrid beamforming design in mmWave massive MIMO systems, namely channel angle map (CAM) and beam index map (BIM). It is shown that compared with existing environment-unaware schemes, the proposed environment-aware hybrid beamforming scheme based on CKM can drastically improve the effective communication rate, even under moderate user location errors, thanks to its great saving of the prohibitive real-time training overhead.


title: Detached eclipsing binaries from the Kepler field: radii and photometric masses of components in short-period systems

abstract: The characterisation of detached eclipsing binaries with low mass components has become important when verifying the role of convection in stellar evolutionary models, which requires model-independent measurements of stellar parameters with great precision. However, spectroscopic characterisation depends on single-target radial velocity observations and only a few tens of well-studied low-mass systems have been diagnosed in this way. We characterise eclipsing detached systems from the {\it Kepler} field with low mass components by adopting a purely-photometric method. Based on an extensive multi-colour dataset, we derive effective temperatures and photometric masses of individual components using clustering techniques. We also estimate the stellar radii from additional modelling of the available {\it Kepler} light curves. Our measurements confirm the presence of an inflation trend in the mass-radius diagram against theoretical stellar models in the low-mass regime.


title: Statistical and Neural Methods for Cross-lingual Entity Label Mapping in Knowledge Graphs

abstract: Knowledge bases such as Wikidata amass vast amounts of named entity information, such as multilingual labels, which can be extremely useful for various multilingual and cross-lingual applications. However, such labels are not guaranteed to match across languages from an information consistency standpoint, greatly compromising their usefulness for fields such as machine translation. In this work, we investigate the application of word and sentence alignment techniques coupled with a matching algorithm to align cross-lingual entity labels extracted from Wikidata in 10 languages. Our results indicate that mapping between Wikidata's main labels stands to be considerably improved (up to $20$ points in F1-score) by any of the employed methods. We show how methods relying on sentence embeddings outperform all others, even across different scripts. We believe the application of such techniques to measure the similarity of label pairs, coupled with a knowledge base rich in high-quality entity labels, to be an excellent asset to machine translation.


title: Melting of magnetization plateaus for kagome and square-kagome lattice antiferromagnets

abstract: Unconventional features of the magnetization curve at zero temperature such as plateaus or jumps are a hallmark of frustrated spin systems. Very little is known about their behavior at non-zero temperatures. Here we investigate the temperature dependence of the magnetization curve of the kagome lattice antiferromagnet in particular at 1/3 of the saturation magnetization for large lattice sizes of up to N=48 spins. We discuss the phenomenon of asymmetric melting and trace it back to a combined effect of unbalanced magnetization steps on either side of the investigated plateau as well as on the behavior of the density of states across the plateau. We compare our findings to the square-kagome lattice that behaves similarly at low temperatures at zero field, but as we will demonstrate differently at 1/3 of the saturation magnetization. Both systems possess a flat one-magnon band and therefore share with the class of flat-band systems the general property that the plateau that precedes the jump to saturation melts asymmetrically but now with a minimal susceptibility that bends towards lower fields with increasing temperature.


title: Ballistic transport of interacting Bose particles in the tight-binding chain

abstract: It is known that quantum transport of non-interacting Bose particles across the tight-binding chain is ballistic in the sense that the current does not depend on the chain length. We address the question whether the transport of strongly interacting bosons can be ballistic as well. We find such a regime and show that, classically, it corresponds to the synchronized motion of local non-linear oscillators. It is also argued that, unlike the case of non-interacting bosons, the transporting state responsible for the ballistic transport of interacting bosons is metastable, i.e., the current decays in course of time. An estimate for the decay time is obtained.


title: An Algorithm for the SE(3)-Transformation on Neural Implicit Maps for Remapping Functions

abstract: Implicit representations are widely used for object reconstruction due to their efficiency and flexibility. In 2021, a novel structure named neural implicit map has been invented for incremental reconstruction. A neural implicit map alleviates the problem of inefficient memory cost of previous online 3D dense reconstruction while producing better quality. % However, the neural implicit map suffers the limitation that it does not support remapping as the frames of scans are encoded into a deep prior after generating the neural implicit map. This means, that neither this generation process is invertible, nor a deep prior is transformable. The non-remappable property makes it not possible to apply loop-closure techniques. % We present a neural implicit map based transformation algorithm to fill this gap. As our neural implicit map is transformable, our model supports remapping for this special map of latent features. % Experiments show that our remapping module is capable to well-transform neural implicit maps to new poses. Embedded into a SLAM framework, our mapping model is able to tackle the remapping of loop closures and demonstrates high-quality surface reconstruction. % Our implementation is available at github\footnote{\url{https://github.com/Jarrome/IMT_Mapping}} for the research community.


title: Evaluating the Impact of Source Code Parsers on ML4SE Models

abstract: As researchers and practitioners apply Machine Learning to increasingly more software engineering problems, the approaches they use become more sophisticated. A lot of modern approaches utilize internal code structure in the form of an abstract syntax tree (AST) or its extensions: path-based representation, complex graph combining AST with additional edges. Even though the process of extracting ASTs from code can be done with different parsers, the impact of choosing a parser on the final model quality remains unstudied. Moreover, researchers often omit the exact details of extracting particular code representations. In this work, we evaluate two models, namely Code2Seq and TreeLSTM, in the method name prediction task backed by eight different parsers for the Java language. To unify the process of data preparation with different parsers, we develop SuperParser, a multi-language parser-agnostic library based on PathMiner. SuperParser facilitates the end-to-end creation of datasets suitable for training and evaluation of ML models that work with structural information from source code. Our results demonstrate that trees built by different parsers vary in their structure and content. We then analyze how this diversity affects the models' quality and show that the quality gap between the most and least suitable parsers for both models turns out to be significant. Finally, we discuss other features of the parsers that researchers and practitioners should take into account when selecting a parser along with the impact on the models' quality. The code of SuperParser is publicly available at https://doi.org/10.5281/zenodo.6366591. We also publish Java-norm, the dataset we use to evaluate the models: https://doi.org/10.5281/zenodo.6366599.


title: Relaxing safety for metric first-order temporal logic via dynamic free variables

abstract: We define a fragment of metric first-order temporal logic formulas that guarantees the finiteness of their table representations. We extend our fragment's definition to cover the temporal dual operators trigger and release and show that our fragment is strictly larger than those previously used in the literature. We integrate these additions into an existing runtime verification tool and formally verify in Isabelle/HOL that the tool correctly outputs the table of constants that satisfy the monitored formula. Finally, we provide some example specifications that are now monitorable thanks to our contributions.


title: Fully on-chip photonic turnkey quantum source for entangled qubit/qudit state generation

abstract: Integrated photonics has recently become a leading platform for the realization and processing of optical entangled quantum states in compact, robust and scalable chip formats with applications in long-distance quantum-secured communication, quantum-accelerated information processing and non-classical metrology. However, the quantum light sources developed so far have relied on external bulky excitation lasers making them impractical, not reproducible prototype devices, hindering scalability and the transfer out of the lab into real-world applications. Here we demonstrate a fully integrated quantum light source, which overcomes these challenges through the combined integration of a laser cavity, a highly efficient tunable noise suppression filter ($> 55$ dB) exploiting the Vernier effect and a nonlinear microring for entangled photon pair generation through spontaneous four-wave mixing. The hybrid quantum source employs an electrically-pumped InP gain section and a Si$_3$N$_4$ low-loss microring filter system, and demonstrates high performance parameters, i.e., a pair emission over four resonant modes in the telecom band (bandwidth $\sim 1$ THz), and a remarkable pair detection rate of $\sim 620$ Hz at a high coincidence-to-accidental ratio of $\sim 80$. The source directly creates high-dimensional frequency-bin entangled quantum states (qubits/qudits), verified by quantum interference measurements with visibilities up to $96\%$ (violating Bell-inequality) and by density matrix reconstruction through state tomography showing fidelities of up to $99\%$. Our approach, leveraging a hybrid photonic platform, enables commercial-viable, low-cost, compact, light-weight, and field-deployable entangled quantum sources, quintessential for practical, out-of-lab applications, e.g., in quantum processors and quantum satellite communications systems.


title: A New Look at the $C^{0}$-formulation of the Strong Cosmic Censorship Conjecture

abstract: We examine the $C^{0}$-formulation of the strong cosmic censorship conjecture (SCC) from a quantum complexity-theoretic perspective and argue that for generic black hole parameters as initial conditions for the Einstein equations, corresponding to the expected geometry of a hyperbolic black hole, the metric is $C^{0}$-extendable to a larger Lorentzian manifold across the Cauchy horizon. To demonstrate the pathologies associated with a hypothetical validity of the $C^{0}$ SCC, we prove it violates the "complexity=volume" conjecture for a low-temperature hyperbolic AdS$_{d+1}$ black hole dual to a CFT living on a ($d-1$)-dimensional hyperboloid $H_{d-1}$, where in order to preserve the gauge/gravity duality we impose a lower bound on the interior metric extendability of order the classical recurrence time.


title: Smoluchowski-Kramers approximation for singular stochastic wave equations in two dimensions

abstract: We study a family of nonlinear damped wave equations indexed by a parameter $\epsilon >0$ and forced by a space-time white noise on the two dimensional torus, with polynomial and sine nonlinearities. We show that as $\epsilon \to 0$, the solutions to these equations converge to the solution of the corresponding two dimensional stochastic quantization equation. In the sine nonlinearity case, the convergence is proven over arbitrary large times, while in the polynomial case, we prove that this approximation result holds over arbitrary large times when the parameter $\epsilon$ goes to zero even with a lack of suitable global well-posedness theory for the corresponding wave equations.


title: CATTO: Just-in-time Test Case Selection and Execution

abstract: Regression testing ensures a System Under Test (SUT) still works as expected after changes to it. The simplest approach for regression testing consists of re-running the entire test suite against the changed version of the SUT. However, this might result in a time- and resource-consuming process; \eg when dealing with large and/or complex SUTs and test suits. To work around this problem, test Case Selection (TCS) strategies can be used. Such strategies seek to build a temporary test suite comprising only those test cases that are relevant to the changes made to the SUT, so avoiding executing those test cases that do not exercise the changed parts. In this paper, we introduce CATTO (Commit Adaptive Tool for Test suite Optimization) and CATTO INTELLIJ PLUGIN. The former is a tool implementing a TCS strategy for SUTs written in Java, while the latter is a wrapper to allow developers to use \toolName directly in IntelliJ. We also conducted a preliminary evaluation of CATTO on seven open-source Java SUTs in terms of reductions in test-suite size, fault-reveling test cases, and fault-detection capability. The results are promising and suggest that CATTO can be of help to developers when performing regression testing. The video demo and the documentation of the tool is available at: \url{https://catto-tool.github.io/}


title: Norm inflation for the derivative nonlinear Schr\"odinger equation

abstract: In this note, we study the ill-posedness problem for the derivative nonlinear Schr\"odinger equation (DNLS) in the one-dimensional setting. More precisely, by using a ternary-quinary tree expansion of the Duhamel formula we prove norm inflation in Sobolev spaces below the (scaling) critical regularity for the gauged DNLS. This ill-posedness result is sharp since DNLS is known to be globally well-posed in $L^2(\mathbb{R})$. The main novelty of our approach is to control the derivative loss from the cubic nonlinearity by the quintic nonlinearity with carefully chosen initial data.


title: Fast Finite Width Neural Tangent Kernel

abstract: The Neural Tangent Kernel (NTK), defined as $\Theta_\theta^f(x_1, x_2) = \left[\partial f(\theta, x_1)\big/\partial \theta\right] \left[\partial f(\theta, x_2)\big/\partial \theta\right]^T$ where $\left[\partial f(\theta, \cdot)\big/\partial \theta\right]$ is a neural network (NN) Jacobian, has emerged as a central object of study in deep learning. In the infinite width limit, the NTK can sometimes be computed analytically and is useful for understanding training and generalization of NN architectures. At finite widths, the NTK is also used to better initialize NNs, compare the conditioning across models, perform architecture search, and do meta-learning. Unfortunately, the finite width NTK is notoriously expensive to compute, which severely limits its practical utility. We perform the first in-depth analysis of the compute and memory requirements for NTK computation in finite width networks. Leveraging the structure of neural networks, we further propose two novel algorithms that change the exponent of the compute and memory requirements of the finite width NTK, dramatically improving efficiency. Our algorithms can be applied in a black box fashion to any differentiable function, including those implementing neural networks. We open-source our implementations within the Neural Tangents package (arXiv:1912.02803) at https://github.com/google/neural-tangents.


title: $n-n'$ Oscillations: Sensitivity of a first UCN beam experiment

abstract: Oscillations of the neutron into a hidden sector particle are processes predicted in various Standard Model extensions. This extra channel for neutron disappearance has not been tested experimentally in large portions of the oscillation parameter space. Several efforts have been recently made on revising the oscillation time limits at low mass-splitting in ultra-cold neutron (UCN) storage experiments, and at larger mass-splitting in passing-through-wall experiments. In this work, we present the expected sensitivity of an experiment searching for neutron hidden neutron oscillations at intermediate mass-splitting via the application of magnetic fields in the range $B_0=30-1100$ $\mu$T. This experiment was performed at the Institut-Laue-Langevin using a novel UCN counter to monitor the beam flux. The measured UCN rate and the data collection technique predict a sensitivity on the oscillation time at the level of a couple of seconds.


title: WaTZ: A Trusted WebAssembly Runtime Environment with Remote Attestation for TrustZone

abstract: WebAssembly (Wasm) is a novel low-level bytecode format that swiftly gained popularity for its efficiency, versatility and security, with near-native performance. Besides, trusted execution environments (TEEs) shield critical software assets against compromised infrastructures. However, TEEs do not guarantee the code to be trustworthy or that it was not tampered with. Instead, one relies on remote attestation to assess the code before execution. This paper describes WaTZ, which is (i) an efficient and secure runtime for trusted execution of Wasm code for Arm's TrustZone TEE, and (ii) a lightweight remote attestation system optimised for Wasm applications running in TrustZone, as it lacks built-in mechanisms for attestation. The remote attestation protocol is formally verified using a state-of-the-art analyser and model checker. Our extensive evaluation of Arm-based hardware uses synthetic and real-world benchmarks, illustrating typical tasks IoT devices achieve. WaTZ's execution speed is on par with Wasm runtimes in the normal world and reaches roughly half the speed of native execution, which is compensated by the additional security guarantees and the interoperability offered by Wasm. WaTZ is open-source and available on GitHub along with instructions to reproduce our experiments.


title: CookDial: A dataset for task-oriented dialogs grounded in procedural documents

abstract: This work presents a new dialog dataset, CookDial, that facilitates research on task-oriented dialog systems with procedural knowledge understanding. The corpus contains 260 human-to-human task-oriented dialogs in which an agent, given a recipe document, guides the user to cook a dish. Dialogs in CookDial exhibit two unique features: (i) procedural alignment between the dialog flow and supporting document; (ii) complex agent decision-making that involves segmenting long sentences, paraphrasing hard instructions and resolving coreference in the dialog context. In addition, we identify three challenging (sub)tasks in the assumed task-oriented dialog system: (1) User Question Understanding, (2) Agent Action Frame Prediction, and (3) Agent Response Generation. For each of these tasks, we develop a neural baseline model, which we evaluate on the CookDial dataset. We publicly release the CookDial dataset, comprising rich annotations of both dialogs and recipe documents, to stimulate further research on domain-specific document-grounded dialog systems.


title: Crowdsourcing Relative Rankings of Multi-Word Expressions: Experts versus Non-Experts

abstract: In this study we investigate to which degree experts and non-experts agree on questions of difficulty in a crowdsourcing experiment. We ask non-experts (second language learners of Swedish) and two groups of experts (teachers of Swedish as a second/foreign language and CEFR experts) to rank multi-word expressions in a crowdsourcing experiment. We find that the resulting rankings by all the three tested groups correlate to a very high degree, which suggests that judgments produced in a comparative setting are not influenced by professional insights into Swedish as a second language.


title: Galois LCD Codes Over Fq + uFq + vFq + uvFq

abstract: In \cite{anote}, Wu and Shi studied $ l $-Galois LCD codes over finite chain ring $\mathcal{R}=\mathbb{F}_q+u\mathbb{F}_q$, where $u^2=0$ and $ q=p^e$ for some prime $p$ and positive integer $e$. In this work, we extend the results to the finite non chain ring $ \mathcal{R} =\mathbb{F}_q+u\mathbb{F}_q+v\mathbb{F}_q+uv\mathbb{F}_q$, where $u^2=u,v^2=v $ and $ uv=vu $. We define a correspondence between $ l $-Galois dual of linear codes over $ \mathcal{R} $ and $ l $-Galois dual of its component codes over $ \mathbb{F}_q .$ Further, we construct Euclidean LCD and $ l $-Galois LCD codes from linear code over $ \mathcal{R} $. This consequently leads us to prove that any linear code over $ \mathcal{R} $ is equivalent to Euclidean ($ q>3 $) and $ l $-Galois LCD ($0<l<e$, and $p^{e-l}+1\mid p^e-1$) code over $ \mathcal{R} .$ Finally, we investigate MDS codes over $ \mathcal{R} .$


title: Evaluation of Contrastive Learning with Various Code Representations for Code Clone Detection

abstract: Code clones are pairs of code snippets that implement similar functionality. Clone detection is a fundamental branch of automatic source code comprehension, having many applications in refactoring recommendation, plagiarism detection, and code summarization. A particularly interesting case of clone detection is the detection of semantic clones, i.e., code snippets that have the same functionality but significantly differ in implementation. A promising approach to detecting semantic clones is contrastive learning (CL), a machine learning paradigm popular in computer vision but not yet commonly adopted for code processing. Our work aims to evaluate the most popular CL algorithms combined with three source code representations on two tasks. The first task is code clone detection, which we evaluate on the POJ-104 dataset containing implementations of 104 algorithms. The second task is plagiarism detection. To evaluate the models on this task, we introduce CodeTransformator, a tool for transforming source code. We use it to create a dataset that mimics plagiarised code based on competitive programming solutions. We trained nine models for both tasks and compared them with six existing approaches, including traditional tools and modern pre-trained neural models. The results of our evaluation show that proposed models perform diversely in each task, however the performance of the graph-based models is generally above the others. Among CL algorithms, SimCLR and SwAV lead to better results, while Moco is the most robust approach. Our code and trained models are available at https://doi.org/10.5281/zenodo.6360627, https://doi.org/10.5281/zenodo.5596345.


title: The ITU Faroese Pairs Dataset

abstract: This article documents a dataset of sentence pairs between Faroese and Danish, produced at ITU Copenhagen. The data covers tranlsation from both source languages, and is intended for use as training data for machine translation systems in this language pair.


title: Iterative importance sampling with Markov chain Monte Carlo sampling in robust Bayesian analysis

abstract: Bayesian inference under a set of priors, called robust Bayesian analysis, allows for estimation of parameters within a model and quantification of epistemic uncertainty in quantities of interest by bounded (or imprecise) probability. Iterative importance sampling can be used to estimate bounds on the quantity of interest by optimizing over the set of priors. A method for iterative importance sampling when the robust Bayesian inference rely on Markov chain Monte Carlo (MCMC) sampling is proposed. To accommodate the MCMC sampling in iterative importance sampling, a new expression for the effective sample size of the importance sampling is derived, which accounts for the correlation in the MCMC samples. To illustrate the proposed method for robust Bayesian analysis, iterative importance sampling with MCMC sampling is applied to estimate the lower bound of the overall effect in a previously published meta-analysis with a random effects model. The performance of the method compared to a grid search method and under different degrees of prior-data conflict is also explored.


title: Monochromatic operation of the SASE3 soft X-ray beamline at European XFEL

abstract: The SASE3 soft X-ray beamline at the European XFEL has been designed and built to provide experiments with pink or monochromatic beam in the photon energy range 250 eV - 3000 eV. Here, we focus on the monochromatic operation of the SASE3 beamline and report on design and performance of the SASE3 grating monochromator. The unique capability of an FEL source to produce short femtosecond pulses of high degree of coherence challenges the monochromator design by a demand to control both photon energy and temporal resolution. The aim to transport close to transform-limited pulses poses very high demands on the optics quality, in particular on the grating. The current realization of the SASE3 monochromator is discussed in comparison with optimal design performance. Presently, the monochromator operates with two gratings: the low-resolution grating is optimized for time-resolved experiments and allows for moderate resolving power of about 2000 - 5000 along with pulse stretching of few to few tens of femtoseconds RMS, and the high-resolution grating reaches resolving power of 10000 at a cost of larger pulse stretching.


title: The X-ray emission of gamma Cassiopeiae during the 2020-2021 disc eruption

abstract: gamma Cas is known for its hard and intense X-ray emission that could trace accretion by a compact companion, wind interaction with a hot sub-dwarf companion, or magnetic interaction between the star and its Be decretion disc. These scenarios should lead to diverse dependences of the hard X-ray emission on disc density. We collected X-ray observations of gamma Cas during an episode of enhanced disc activity around January 2021. We investigate the variations in the disc properties using time series of dedicated optical spectroscopy and existing broadband photometry. Epoch-dependent Doppler maps of the H-alpha, H-beta, and He I 5876 emission lines are built to characterise the emission regions in velocity space. We analyse 4 XMM-Newton observations taken at key phases of the enhanced disc activity episode. Archival data are used to study the long-term correlation between optical and X-ray emission. Optical spectroscopy unveils an increase in the radial extent of the emission regions during the episode of enhanced disc activity, whilst no increase in the V-band flux is recorded. Doppler maps do not reveal any stable feature in the disc resulting from the putative action of the companion on the outer parts of the Be disc. No increase in the hard emission is observed in relation to the enhanced disc activity. However, at two occasions, the soft X-ray emission of gamma Cas is strongly attenuated, suggesting more efficient obscuration by a large flaring Be disc. There is a strong correlation between the long-term variations in the X-ray flux and in the V-band photometry. The observed behaviour of gamma Cas suggests no direct link between the properties of the outer regions of the Be disc and the hard X-ray emission, but favours a link between the level of X-ray emission and the properties of the inner part of the Be disc. These results thus disfavour an accretion or colliding wind scenario.


title: Robust Information Criterion for Model Selection in Sparse High-Dimensional Linear Regression Models

abstract: Model selection in linear regression models is a major challenge when dealing with high-dimensional data where the number of available measurements (sample size) is much smaller than the dimension of the parameter space. Traditional methods for model selection such as Akaike information criterion, Bayesian information criterion (BIC) and minimum description length are heavily prone to overfitting in the high-dimensional setting. In this regard, extended BIC (EBIC), which is an extended version of the original BIC and extended Fisher information criterion (EFIC), which is a combination of EBIC and Fisher information criterion, are consistent estimators of the true model as the number of measurements grows very large. However, EBIC is not consistent in high signal-to-noise-ratio (SNR) scenarios where the sample size is fixed and EFIC is not invariant to data scaling resulting in unstable behaviour. In this paper, we propose a new form of the EBIC criterion called EBIC-Robust, which is invariant to data scaling and consistent in both large sample size and high-SNR scenarios. Analytical proofs are presented to guarantee its consistency. Simulation results indicate that the performance of EBIC-Robust is quite superior to that of both EBIC and EFIC.


title: Meromorphic Solutions of Homogeneous and Non-homogeneous Higher Order Linear Difference Equations in Terms of (p,q)-Order

abstract: In this paper we investigate the growth of meromorphic solutions of homogeneous and non-homogeneous linear difference equations with entire or meromorphic coefficients. We further extend and improve few results on the order of meromorphic solutions by using (p,q)-lower order and (p,q)-lower type followed by the investigation of Luo and Zheng (2016), Belaidi and Bellaama (2020).


title: Efficient WiFi LiDAR SLAM for Autonomous Robots in Large Environments

abstract: Autonomous robots operating in indoor and GPS denied environments can use LiDAR for SLAM instead. However, LiDARs do not perform well in geometrically-degraded environments, due to the challenge of loop closure detection and computational load to perform scan matching. Existing WiFi infrastructure can be exploited for localization and mapping with low hardware and computational cost. Yet, accurate pose estimation using WiFi is challenging as different signal values can be measured at the same location due to the unpredictability of signal propagation. Therefore, we introduce the use of WiFi fingerprint sequence for pose estimation (i.e. loop closure) in SLAM. This approach exploits the spatial coherence of location fingerprints obtained while a mobile robot is moving. This has better capability of correcting odometry drift. The method also incorporates LiDAR scans and thus, improving computational efficiency for large and geometrically-degraded environments while maintaining the accuracy of LiDAR SLAM. We conducted experiments in an indoor environment to illustrate the effectiveness of the method. The results are evaluated based on Root Mean Square Error (RMSE) and it has achieved an accuracy of 0.88m for the test environment.


title: A remark on Kashin's discrepancy argument and partial coloring in the Koml\'{o}s conjecture

abstract: In this expository note, we discuss an early partial coloring result of B. Kashin [C. R. Acad. Bulgare Sci., 1985]. Although this result only implies Spencer's six standard deviations [Trans. Amer. Math. Soc., 1985] up to a $\log\log n$ factor, Kashin's argument gives a simple proof of the existence of a constant discrepancy partial coloring in the setup of Koml\'{o}s conjecture.


title: A Co-design view of Compute in-Memory with Non-Volatile Elements for Neural Networks

abstract: Deep Learning neural networks are pervasive, but traditional computer architectures are reaching the limits of being able to efficiently execute them for the large workloads of today. They are limited by the von Neumann bottleneck: the high cost in energy and latency incurred in moving data between memory and the compute engine. Today, special CMOS designs address this bottleneck. The next generation of computing hardware will need to eliminate or dramatically mitigate this bottleneck. We discuss how compute-in-memory can play an important part in this development. Here, a non-volatile memory based cross-bar architecture forms the heart of an engine that uses an analog process to parallelize the matrix vector multiplication operation, repeatedly used in all neural network workloads. The cross-bar architecture, at times referred to as a neuromorphic approach, can be a key hardware element in future computing machines. In the first part of this review we take a co-design view of the design constraints and the demands it places on the new materials and memory devices that anchor the cross-bar architecture. In the second part, we review what is knows about the different new non-volatile memory materials and devices suited for compute in-memory, and discuss the outlook and challenges.


title: Generalised Policy Improvement with Geometric Policy Composition

abstract: We introduce a method for policy improvement that interpolates between the greedy approach of value-based reinforcement learning (RL) and the full planning approach typical of model-based RL. The new method builds on the concept of a geometric horizon model (GHM, also known as a gamma-model), which models the discounted state-visitation distribution of a given policy. We show that we can evaluate any non-Markov policy that switches between a set of base Markov policies with fixed probability by a careful composition of the base policy GHMs, without any additional learning. We can then apply generalised policy improvement (GPI) to collections of such non-Markov policies to obtain a new Markov policy that will in general outperform its precursors. We provide a thorough theoretical analysis of this approach, develop applications to transfer and standard RL, and empirically demonstrate its effectiveness over standard GPI on a challenging deep RL continuous control task. We also provide an analysis of GHM training methods, proving a novel convergence result regarding previously proposed methods and showing how to train these models stably in deep RL settings.