title: A Theoretical-Empirical Approach to Estimating Sample Complexity of DNNs

abstract: This paper focuses on understanding how the generalization error scales with the amount of the training data for deep neural networks (DNNs). Existing techniques in statistical learning require computation of capacity measures, such as VC dimension, to provably bound this error. It is however unclear how to extend these measures to DNNs and therefore the existing analyses are applicable to simple neural networks, which are not used in practice, e.g., linear or shallow ones or otherwise multi-layer perceptrons. Moreover, many theoretical error bounds are not empirically verifiable. We derive estimates of the generalization error that hold for deep networks and do not rely on unattainable capacity measures. The enabling technique in our approach hinges on two major assumptions: i) the network achieves zero training error, ii) the probability of making an error on a test point is proportional to the distance between this point and its nearest training point in the feature space and at a certain maximal distance (that we call radius) it saturates. Based on these assumptions we estimate the generalization error of DNNs. The obtained estimate scales as O(1/(\delta N^{1/d})), where N is the size of the training data and is parameterized by two quantities, the effective dimensionality of the data as perceived by the network (d) and the aforementioned radius (\delta), both of which we find empirically. We show that our estimates match with the experimentally obtained behavior of the error on multiple learning tasks using benchmark data-sets and realistic models. Estimating training data requirements is essential for deployment of safety critical applications such as autonomous driving etc. Furthermore, collecting and annotating training data requires a huge amount of financial, computational and human resources. Our empirical estimates will help to efficiently allocate resources.


title: Q-Rater: Non-Convex Optimization for Post-Training Uniform Quantization

abstract: Various post-training uniform quantization methods have usually been studied based on convex optimization. As a result, most previous ones rely on the quantization error minimization and/or quadratic approximations. Such approaches are computationally efficient and reasonable when a large number of quantization bits are employed. When the number of quantization bits is relatively low, however, non-convex optimization is unavoidable to improve model accuracy. In this paper, we propose a new post-training uniform quantization technique considering non-convexity. We empirically show that hyper-parameters for clipping and rounding of weights and activations can be explored by monitoring task loss. Then, an optimally searched set of hyper-parameters is frozen to proceed to the next layer such that an incremental non-convex optimization is enabled for post-training quantization. Throughout extensive experimental results using various models, our proposed technique presents higher model accuracy, especially for a low-bit quantization.


title: Encoding Weights of Irregular Sparsity for Fixed-to-Fixed Model Compression

abstract: Even though fine-grained pruning techniques achieve a high compression ratio, conventional sparsity representations (such as CSR) associated with irregular sparsity degrade parallelism significantly. Practical pruning methods, thus, usually lower pruning rates (by structured pruning) to improve parallelism. In this paper, we study fixed-to-fixed (lossless) encoding architecture/algorithm to support fine-grained pruning methods such that sparse neural networks can be stored in a highly regular structure. We first estimate the maximum compression ratio of encoding-based compression using entropy. Then, as an effort to push the compression ratio to the theoretical maximum (by entropy), we propose a sequential fixed-to-fixed encoding scheme. We demonstrate that our proposed compression scheme achieves almost the maximum compression ratio for the Transformer and ResNet-50 pruned by various fine-grained pruning methods.


title: Unusual magnetotransport in twisted bilayer graphene

abstract: We present transport measurements of bilayer graphene with 1.38{\deg} interlayer twist and apparent additional alignment to its hexagonal boron nitride cladding. As with other devices with twist angles substantially larger than the magic angle of 1.1{\deg}, we do not observe correlated insulating states or band reorganization. However, we do observe several highly unusual behaviors in magnetotransport. For a large range of densities around half filling of the moir\'e bands, magnetoresistance is large and quadratic. Over these same densities, the magnetoresistance minima corresponding to gaps between Landau levels split and bend as a function of density and field. We reproduce the same splitting and bending behavior in a simple tight-binding model of Hofstadter's butterfly on a square lattice with anisotropic hopping terms. These features appear to be a generic class of experimental manifestations of Hofstadter's butterfly and may provide insight into the emergent states of twisted bilayer graphene.


title: Discrete Spectrum of ULF Oscillations of the Ionosphere

abstract: This work relates to the field of ultra-low-frequency (ULF) spectroscopy of near-Earth plasma. Our attention is focused on the Alfv\'en ionospheric resonator (IAR), the spectrum of which is a series of discrete lines. The aim of the study is to experimentally verify a well-defined theoretical prediction. Within the framework of an idealized resonator model, a hypothesis about the relationship between the frequencies of spectral lines has been formulated. To test the hypothesis, observations of ULF oscillations at the mid-latitude Mondy observatory were used. The result of the analysis confirmed the hypothesis that odd harmonics of the IAR discrete spectrum are observed on the Earth's surface. Key words: electromagnetic oscillations, Alfv\'en waves, ionospheric Alfv\'en resonator, ultra-low-frequency spectroscopy.


title: $d$- and $p$-wave quantum liquid crystal orders in cuprate superconductors, $\kappa$-(BEDT-TTF)$_2$X, and coupled chain Hubbard models: functional-renormalization-group analysis

abstract: Unconventional symmetry breaking without spin order,such as the rotational symmetry breaking (=nematic or smectic) orders as well as the spontaneous loop-current orders, have been recently reported in cuprate superconductors and their related materials.They are theoretically represented by non-$A_{1g}$ symmetry breaking in self-energy, which we call the form factor $f_{k,q}$.In this paper, we analyze typical Hubbard models by applying the renormalization-group (RG) method, and find that various unconventional ordering emerges due to the quantum interference among spin fluctuations. Due to this mechanism,nematic ($q=0$) and smectic ($q \ne 0$)bond orders with $d$-wave form factor appear $f_{k,q}\propto \cos k_x - \cos k_y$ in both cuprates and $\kappa$-(BEDT-TTF)$_2$X. The derived bond orders naturally explain the pseudogap behaviors in these compounds. The quantum interference also induces various current orders with odd-parity form factor. For example, we find the emergence of the charge and spin loop-current orders with $p$-wave form factor in geometrically frustrated Hubbard models. Thus, rich quantum phase transitions with $d$- and $p$-wave form factors are driven by the paramagnon interference in many low-dimensional Hubbard models.


title: G\"{o}del-McKinsey-Tarski and Blok-Esakia for Heyting-Lewis Implication

abstract: Heyting-Lewis Logic is the extension of intuitionistic propositional logic with a strict implication connective that satisfies the constructive counterparts of axioms for strict implication provable in classical modal logics. Variants of this logic are surprisingly widespread: they appear as Curry-Howard correspondents of (simple type theory extended with) Haskell-style arrows, in preservativity logic of Heyting arithmetic, in the proof theory of guarded (co)recursion, and in the generalization of intuitionistic epistemic logic. Heyting-Lewis Logic can be interpreted in intuitionistic Kripke frames extended with a binary relation to account for strict implication. We use this semantics to define descriptive frames (generalisations of Esakia spaces), and establish a categorical duality between the algebraic interpretation and the frame semantics. We then adapt a transformation by Wolter and Zakharyaschev to translate Heyting-Lewis Logic to classical modal logic with two unary operators. This allows us to prove a Blok-Esakia theorem that we then use to obtain both known and new canonicity and correspondence theorems, and the finite model property and decidability for a large family of Heyting-Lewis logics.


title: On the Optimality of Nuclear-norm-based Matrix Completion for Problems with Smooth Non-linear Structure

abstract: Originally developed for imputing missing entries in low rank, or approximately low rank matrices, matrix completion has proven widely effective in many problems where there is no reason to assume low-dimensional linear structure in the underlying matrix, as would be imposed by rank constraints. In this manuscript, we build some theoretical intuition for this behavior. We consider matrices which are not necessarily low-rank, but lie in a low-dimensional non-linear manifold. We show that nuclear-norm penalization is still effective for recovering these matrices when observations are missing completely at random. In particular, we give upper bounds on the rate of convergence as a function of the number of rows, columns, and observed entries in the matrix, as well as the smoothness and dimension of the non-linear embedding. We additionally give a minimax lower bound: This lower bound agrees with our upper bound (up to a logarithmic factor), which shows that nuclear-norm penalization is (up to log terms) minimax rate optimal for these problems.


title: Modulating Regularization Frequency for Efficient Compression-Aware Model Training

abstract: While model compression is increasingly important because of large neural network size, compression-aware training is challenging as it needs sophisticated model modifications and longer training time.In this paper, we introduce regularization frequency (i.e., how often compression is performed during training) as a new regularization technique for a practical and efficient compression-aware training method. For various regularization techniques, such as weight decay and dropout, optimizing the regularization strength is crucial to improve generalization in Deep Neural Networks (DNNs). While model compression also demands the right amount of regularization, the regularization strength incurred by model compression has been controlled only by compression ratio. Throughout various experiments, we show that regularization frequency critically affects the regularization strength of model compression. Combining regularization frequency and compression ratio, the amount of weight updates by model compression per mini-batch can be optimized to achieve the best model accuracy. Modulating regularization frequency is implemented by occasional model compression while conventional compression-aware training is usually performed for every mini-batch.


title: Change Matters: Medication Change Prediction with Recurrent Residual Networks

abstract: Deep learning is revolutionizing predictive healthcare, including recommending medications to patients with complex health conditions. Existing approaches focus on predicting all medications for the current visit, which often overlaps with medications from previous visits. A more clinically relevant task is to identify medication changes. In this paper, we propose a new recurrent residual network, named MICRON, for medication change prediction. MICRON takes the changes in patient health records as input and learns to update a hidden medication vector and the medication set recurrently with a reconstruction design. The medication vector is like the memory cell that encodes longitudinal information of medications. Unlike traditional methods that require the entire patient history for prediction, MICRON has a residual-based inference that allows for sequential updating based only on new patient features (e.g., new diagnoses in the recent visit) more efficiently. We evaluated MICRON on real inpatient and outpatient datasets. MICRON achieves 3.5% and 7.8% relative improvements over the best baseline in F1 score, respectively. MICRON also requires fewer parameters, which significantly reduces the training time to 38.3s per epoch with 1.5x speed-up.


title: A Comprehensive Framework for Analyzing IoT Platforms: A Smart City Industrial Experience

abstract: The compliance of IoT platforms to quality is paramount to achieve users satisfaction. Currently, we do not have a comprehensive set of guidelines to appraise and select the most suitable IoT platform architectures that meet relevant criteria. This paper is a tentative response to this critical knowledge gap where we adopted the design science research approach to develop a novel evaluation framework. Our research, on the one hand, stimulates an unbiased competition among IoT platform providers and, on the other hand, establishes a solid foundation for IoT platform consumers to make informed decisions in this multiplicity. The application of the framework is illustrated in example scenarios. Moreover, lessons learned from applying design science research are shared.


title: The EMPATHIC Project: Mid-term Achievements

abstract: The goal of active aging is to promote changes in the elderly community so as to maintain an active, independent and socially-engaged lifestyle. Technological advancements currently provide the necessary tools to foster and monitor such processes. This paper reports on mid-term achievements of the European H2020 EMPATHIC project, which aims to research, innovate, explore and validate new interaction paradigms and platforms for future generations of personalized virtual coaches to assist the elderly and their carers to reach the active aging goal, in the vicinity of their home. The project focuses on evidence-based, user-validated research and integration of intelligent technology, and context sensing methods through automatic voice, eye and facial analysis, integrated with visual and spoken dialogue system capabilities. In this paper, we describe the current status of the system, with a special emphasis on its components and their integration, the creation of a Wizard of Oz platform, and findings gained from user interaction studies conducted throughout the first 18 months of the project.


title: MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space

abstract: Detecting out-of-distribution (OOD) inputs is a central challenge for safely deploying machine learning models in the real world. Existing solutions are mainly driven by small datasets, with low resolution and very few class labels (e.g., CIFAR). As a result, OOD detection for large-scale image classification tasks remains largely unexplored. In this paper, we bridge this critical gap by proposing a group-based OOD detection framework, along with a novel OOD scoring function termed MOS. Our key idea is to decompose the large semantic space into smaller groups with similar concepts, which allows simplifying the decision boundaries between in- vs. out-of-distribution data for effective OOD detection. Our method scales substantially better for high-dimensional class space than previous approaches. We evaluate models trained on ImageNet against four carefully curated OOD datasets, spanning diverse semantics. MOS establishes state-of-the-art performance, reducing the average FPR95 by 14.33% while achieving 6x speedup in inference compared to the previous best method.


title: Hankel Determinants of shifted sequences of Bernoulli and Euler numbers

abstract: Hankel determinants of sequences related to Bernoulli and Euler numbers have been studied before, and numerous identities are known. However, when a sequence is shifted by one unit, the situation often changes significantly. In this paper we use classical orthogonal polynomials and related methods to prove a general result concerning Hankel determinants for shifted sequences. We then apply this result to obtain new Hankel determinant evaluations for a total of $13$ sequences related to Bernoulli and Euler numbers, one of which concerns Euler polynomials.


title: Engineering Blockchain Based Software Systems: Foundations, Survey, and Future Directions

abstract: Many scientific and practical areas have shown increasing interest in reaping the benefits of blockchain technology to empower software systems. However, the unique characteristics and requirements associated with Blockchain Based Software (BBS) systems raise new challenges across the development lifecycle that entail an extensive improvement of conventional software engineering. This article presents a systematic literature review of the state-of-the-art in BBS engineering research from a software engineering perspective. We characterize BBS engineering from the theoretical foundations, processes, models, and roles and discuss a rich repertoire of key development activities, principles, challenges, and techniques. The focus and depth of this survey not only gives software engineering practitioners and researchers a consolidated body of knowledge about current BBS development but also underpins a starting point for further research in this field.


title: A Robotic Approach towards Quantifying Epipelagic Bound Plastic Using Deep Visual Models

abstract: The quantification of positively buoyant marine plastic debris is critical to understanding how plastic litter accumulates across the world's oceans and is also crucial to identifying hotspots for targeted cleanup efforts. Currently, the most common method to quantify marine plastic is using manta trawls for manual sampling. However, this method is cost-intensive and requires human labor. This study removes the need for manual sampling by using an autonomous method using neural networks and computer vision models, which trained on images captured from various layers of the ocean column to perform real-time plastic quantification. The best performing model has a Mean Average Precision of 85% and an F1-Score of 0.89 while maintaining near real-time processing speeds ~2 ms/img.


title: RepMLP: Re-parameterizing Convolutions into Fully-connected Layers for Image Recognition

abstract: We propose RepMLP, a multi-layer-perceptron-style neural network building block for image recognition, which is composed of a series of fully-connected (FC) layers. Compared to convolutional layers, FC layers are more efficient, better at modeling the long-range dependencies and positional patterns, but worse at capturing the local structures, hence usually less favored for image recognition. We propose a structural re-parameterization technique that adds local prior into an FC to make it powerful for image recognition. Specifically, we construct convolutional layers inside a RepMLP during training and merge them into the FC for inference. On CIFAR, a simple pure-MLP model shows performance very close to CNN. By inserting RepMLP in traditional CNN, we improve ResNets by 1.8% accuracy on ImageNet, 2.9% for face recognition, and 2.3% mIoU on Cityscapes with lower FLOPs. Our intriguing findings highlight that combining the global representational capacity and positional perception of FC with the local prior of convolution can improve the performance of neural network with faster speed on both the tasks with translation invariance (e.g., semantic segmentation) and those with aligned images and positional patterns (e.g., face recognition). The code and models are available at https://github.com/DingXiaoH/RepMLP.


title: Comparison of ground-based and Gaia photometry of astrometric radio sources

abstract: A comparison was made between $Gaia$ magnitudes and magnitudes obtained from ground-based observations for astrometric radio sources . The comparison showed that these magnitudes often not agree well. There may be several reasons for this disagreement. Nevertheless, such an analysis can serve as an additional filter for verification of the object cross-identification. On the other hand, it can help to detect possible errors in optical magnitudes of astrometric radio sources coming from unreliable or inconsistent data sources.


title: Box Dimension of Mixed Katugampola Fractional Integral of Two-Dimensional Continuous Functions

abstract: The goal of this article is to study the box dimension of the mixed Katugampola fractional integral of two-dimensional continuous functions on [0; 1]X[0; 1]. We prove that the box dimension of the mixed Katugampola fractional integral having fractional order (\alpha = (\alpha_1; \alpha_2); \alpha_1 > 0; \alpha_2 > 0) of two-dimensional continuous functions on [0; 1]X[0; 1] is still two. Moreover, the results are also established for the mixed Hadamard fractional integral.


title: Superconductivity in Nb2Pd3Te5 and Chemically-Doped Ta2Pd3Te5

abstract: We report on the superconductivity in ternary transition metal tellurides Ta2Pd3Te5 and Nb2Pd3Te5, which have a one-dimensional crystal structure. Single-crystalline and polycrystalline samples of Ta2Pd3Te5 show nonmetallic electron conduction, while Ti or W doping results in metallic behavior with a bulk superconducting transition at 2-4 K. In contrast, the polycrystalline samples of Nb2Pd3Te5, which are found to be isostructural to Ta2Pd3Te5, show a bulk superconducting transition at 3.3 K. The crystal structure and physical properties of Ta2Pd3Te5 and Nb2Pd3Te5 are also discussed in comparison with a candidate excitonic insulator Ta2NiSe5.


title: Special Liouville metric with the Ricci condition

abstract: Two necessary conditions for the induced metrics of parallel mean curvature surfaces in a complex space form of complex two-dimension are observed. One is similar to the Ricci condition of the classical surface theory in Euclidean three-space and the other is related to the Liouville metric. Conversely, we prove that a special type of the Liouville metric on a domain in the Euclidean two-plane whose Gaussian curvature satisfies the differential equation similar to the Ricci condition is explicitly determined by an elliptic function. We have isometric immersions from a simply connected two-dimensional Riemannian manifold with the special type of the Liouville metric satisfying the Ricci condition to the complex hyperbolic plane with parallel mean curvature vector.


title: Rabi-like splitting and refractive index sensing with hybrid Tamm plasmon-cavity modes

abstract: Rabi-like splitting and self-referenced refractive index sensing in hybrid plasmonic-1D photonic crystal structures have been theoretically demonstrated. The coupling between Tamm plasmon and cavity photon modes are tuned by incorporating a low refractive index spacer layer adjacent to the metallic layer to form their hybrid modes. Anticrossing of the modes observed at different values of spacer layer thickness validates the strong coupling between the two modes and causes Rabi-like splitting with different splitting energy. Rabi-like splitting energy decreases with increasing number of periods (N) and refractive index contrast ({\eta}) of two dielectric materials used to make the 1D photonic crystals, and the observed variation is explained by an analytical model. Angular and polarization dependency of the hybrid modes shows that the polarization splitting of the lower hybrid mode is much stronger than that of the upper hybrid mode. On further investigation, it is seen that one of the hybrid modes remains unchanged while other mode undergoes significant change with varying the cavity medium. This nature of the hybrid modes has been utilized for designing self-referenced refractive index sensors for sensing different analytes. For {\eta}=1.333 and N=10 in a hybrid structure, the sensitivity increases from 51 nm/RIU to 201 nm/RIU with increasing cavity thickness from 170 nm to 892 nm. For the fixed cavity thickness of 892 nm, the sensitivity increases from 201 nm/RIU to 259 nm/RIU by increasing {\eta} from 1.333 to 1.605. The sensing parameters such as detection accuracy, quality factor, and figure of merit for two different hybrid structures ([{\eta}=1.333, N=10] and [{\eta}=1.605, N=6]) have been evaluated and compared. The value of resonant reflectivity of one of the hybrid modes changes considerably with varying analyte medium which can be used for refractive index sensing.


title: Density-Aware Federated Imitation Learning for Connected and Automated Vehicles with Unsignalized Intersection

abstract: Intelligent Transportation System (ITS) has become one of the essential components in Industry 4.0. As one of the critical indicators of ITS, efficiency has attracted wide attention from researchers. However, the next generation of urban traffic carried by multiple transport service providers may prohibit the raw data interaction among multiple regions for privacy reasons, easily ignored in the existing research. This paper puts forward a federated learning-based vehicle control framework to solve the above problem, including interactors, trainers, and an aggregator. In addition, the density-aware model aggregation method is utilized in this framework to improve vehicle control. What is more, to promote the performance of the end-to-end learning algorithm in the safety aspect, this paper proposes an imitation learning algorithm, which can obtain collision avoidance capabilities from a set of collision avoidance rules. Furthermore, a loss-aware experience selection strategy is also explored, reducing the communication overhead between the interactors and the trainers via extra computing. Finally, the experiment results demonstrate that the proposed imitation learning algorithm obtains the ability to avoid collisions and reduces discomfort by 55.71%. Besides, density-aware model aggregation can further reduce discomfort by 41.37%, and the experience selection scheme can reduce the communication overhead by 12.80% while ensuring model convergence.


title: Self-bias voltage formation and charged particle dynamics in multi-frequency capacitively coupled plasmas

abstract: In this work, we analyze the creation of the discharge asymmetry and the concomitant formation of the DC self-bias voltage in capacitively coupled radio frequency plasmas driven by multi-frequency waveforms, as a function of the electrode surface characteristics. For this latter, we consider and vary the coefficients that characterize the elastic reflection of the electrons from the surfaces and the ion-induced secondary electron yield. Our investigations are based on Particle-in-Cell/Monte Carlo Collision simulations of the plasma and on a model that aids the understanding of the computational results. Electron reflection from the electrodes is found to affect slightly the discharge asymmetry in the presence of multi-frequency excitation, whereas secondary electrons cause distinct changes to the asymmetry of the plasma as a function of the phase angle between the harmonics of the driving voltage waveform and as a function the number of these harmonics.


title: Exploring emotional prototypes in a high dimensional TTS latent space

abstract: Recent TTS systems are able to generate prosodically varied and realistic speech. However, it is unclear how this prosodic variation contributes to the perception of speakers' emotional states. Here we use the recent psychological paradigm 'Gibbs Sampling with People' to search the prosodic latent space in a trained GST Tacotron model to explore prototypes of emotional prosody. Participants are recruited online and collectively manipulate the latent space of the generative speech model in a sequentially adaptive way so that the stimulus presented to one group of participants is determined by the response of the previous groups. We demonstrate that (1) particular regions of the model's latent space are reliably associated with particular emotions, (2) the resulting emotional prototypes are well-recognized by a separate group of human raters, and (3) these emotional prototypes can be effectively transferred to new sentences. Collectively, these experiments demonstrate a novel approach to the understanding of emotional speech by providing a tool to explore the relation between the latent space of generative models and human semantics.


title: TENET: A Framework for Modeling Tensor Dataflow Based on Relation-centric Notation

abstract: Accelerating tensor applications on spatial architectures provides high performance and energy-efficiency, but requires accurate performance models for evaluating various dataflow alternatives. Such modeling relies on the notation of tensor dataflow and the formulation of performance metrics. Recent proposed compute-centric and data-centric notations describe the dataflow using imperative directives. However, these two notations are less expressive and thus lead to limited optimization opportunities and inaccurate performance models. In this paper, we propose a framework TENET that models hardware dataflow of tensor applications. We start by introducing a relation-centric notation, which formally describes the hardware dataflow for tensor computation. The relation-centric notation specifies the hardware dataflow, PE interconnection, and data assignment in a uniform manner using relations. The relation-centric notation is more expressive than the compute-centric and data-centric notations by using more sophisticated affine transformations. Another advantage of relation-centric notation is that it inherently supports accurate metrics estimation, including data reuse, bandwidth, latency, and energy. TENET computes each performance metric by counting the relations using integer set structures and operators. Overall, TENET achieves 37.4\% and 51.4\% latency reduction for CONV and GEMM kernels compared with the state-of-the-art data-centric notation by identifying more sophisticated hardware dataflows.


title: Full-Sentence Models Perform Better in Simultaneous Translation Using the Information Enhanced Decoding Strategy

abstract: Simultaneous translation, which starts translating each sentence after receiving only a few words in source sentence, has a vital role in many scenarios. Although the previous prefix-to-prefix framework is considered suitable for simultaneous translation and achieves good performance, it still has two inevitable drawbacks: the high computational resource costs caused by the need to train a separate model for each latency $k$ and the insufficient ability to encode information because each target token can only attend to a specific source prefix. We propose a novel framework that adopts a simple but effective decoding strategy which is designed for full-sentence models. Within this framework, training a single full-sentence model can achieve arbitrary given latency and save computational resources. Besides, with the competence of the full-sentence model to encode the whole sentence, our decoding strategy can enhance the information maintained in the decoded states in real time. Experimental results show that our method achieves better translation quality than baselines on 4 directions: Zh$\rightarrow$En, En$\rightarrow$Ro and En$\leftrightarrow$De.


title: Interaction of cosmological domain walls with large classical objects, like planets and satellites, and the flyby anomaly

abstract: Cosmological domain walls can be formed as a result of symmetry breaking at any epoch during the evolution of our universe. We study their interaction with a classical macroscopic object, like Earth or a satellite in Earth's orbit. We set up an action that includes the interaction term between the massive classical object and the scalar field that the domain wall is made of. We use numerical calculations to solve the coupled equations of motion which describe the crossing between the domain wall and the classical object. Depending on the strength of the interaction, relative velocity and size, the object can be either stopped by the wall, or it can pass through it inducing deformations in the wall that cost energy. At the same time, the coupling to the scalar filed might change the object's mass during the crossover. The fact that satellites in Earth's orbit (or planets in Sun's orbit) can change their mass and/or lose energy interacting with walls can be used as a new domain wall detection probe. For example, a typical velocity precision of a satellite is about $0.5$ mm/s, which directly puts an upper limit on its mass change to $\Delta M/M \lessapprox 5\times 10^{-17} $. Alternatively, a known satellite flyby anomaly can easily be explained as an interaction with a closed domain wall. We also show that the presence of matter modifies the scalar filed potential and can locally create a bubble of the true vacuum, and thus trigger the decay of the false vacuum. For a critical bubble which is able to expand, such an interaction with the domain wall must be strong enough.


title: On Products of Strong Skolem Starters

abstract: In 1991, Shalaby conjectured that any $\mathbb{Z}_{n}$, where $n\equiv 1$ or $3\pmod{8},\ n\ge 11$, admits a strong Skolem starter. In 2018, the authors explicitly constructed some infinite "cardioidal" families of strong Skolem starters. No other infinite families of these combinatorial designs were known to date. Statements regarding the products of starters, proven in this paper give a new way of generating strong or skew Skolem starters of composite orders. This approach extends our previous result by generating new infinite families that are not cardioidal. The products that we introduce in this paper are multi-valued binary operations which produce 2-partitions of the set $\mathbb{Z}^*_{nm}$ of integers modulo $nm$ without zero, from a pair of 2-partitions of $\mathbb{Z}^*_n$ and $\mathbb{Z}^*_m$, where $n, m\ge 3$ are odd integers. We prove several remarkable properties of these operations applied to starters in $\mathbb{Z}_n$ and to some other combinatorial objects that are 2-partitions of $\mathbb{Z}^*_n$ with additional restrictions, such as strong, skew, Skolem and cardioidal 2-partitions.


title: Radiative neutrino masses: A window to new physics

abstract: Neutrino oscillations constitute the first experimental confirmation of new physics, as they require a new piece that is absent in the Standard Model, non-zero neutrino masses. Questions such as how these masses are generated or why they are so small compared to other masses, are still under investigation. In this thesis, we study radiative neutrino mass models, a class of models where small neutrino masses are generated naturally, while the energy scale at which new physics appears is still low enough to be tested by current and future experiments, offering a falsifiable window to test beyond the Standard Model physics. In these models, neutrino masses are forbidden at the tree-level, but allowed at a certain order in loops. Consequently, we get masses suppressed by loop factors without requiring a large new physics scale and/or small couplings. In particular, we study the systematic classifications of the $d=7$ Majorana neutrino mass operator at one-loop order, the Weinberg operator at three-loop order and the $d=4$ Dirac neutrino mass models at the two-loop level. We then move to more specific models and mechanisms, analysing the connection between the generation of radiative neutrino masses and the stability of dark matter from a model-independent point of view, and examine a particular realisation of the type-I seesaw which relies on the radiative generation of Dirac Yukawa coupling. Finally, we analyse the phenomenology of some of the models discussed in the classifications, as well as a very particular case of neutrinoless double-$\beta$ decay where electrons are emitted with opposite chiralities along with a light scalar (Majoron).


title: Improved feature extraction for CRNN-based multiple sound source localization

abstract: In this work, we propose to extend a state-of-the-art multi-source localization system based on a convolutional recurrent neural network and Ambisonics signals. We significantly improve the performance of the baseline network by changing the layout between convolutional and pooling layers. We propose several configurations with more convolutional layers and smaller pooling sizes in-between, so that less information is lost across the layers, leading to a better feature extraction. In parallel, we test the system's ability to localize up to 3 sources, in which case the improved feature extraction provides the most significant boost in accuracy. We evaluate and compare these improved configurations on synthetic and real-world data. The obtained results show a quite substantial improvement of the multiple sound source localization performance over the baseline network.


title: CoSA: Scheduling by Constrained Optimization for Spatial Accelerators

abstract: Recent advances in Deep Neural Networks (DNNs) have led to active development of specialized DNN accelerators, many of which feature a large number of processing elements laid out spatially, together with a multi-level memory hierarchy and flexible interconnect. While DNN accelerators can take advantage of data reuse and achieve high peak throughput, they also expose a large number of runtime parameters to the programmers who need to explicitly manage how computation is scheduled both spatially and temporally. In fact, different scheduling choices can lead to wide variations in performance and efficiency, motivating the need for a fast and efficient search strategy to navigate the vast scheduling space. To address this challenge, we present CoSA, a constrained-optimization-based approach for scheduling DNN accelerators. As opposed to existing approaches that either rely on designers' heuristics or iterative methods to navigate the search space, CoSA expresses scheduling decisions as a constrained-optimization problem that can be deterministically solved using mathematical optimization techniques. Specifically, CoSA leverages the regularities in DNN operators and hardware to formulate the DNN scheduling space into a mixed-integer programming (MIP) problem with algorithmic and architectural constraints, which can be solved to automatically generate a highly efficient schedule in one shot. We demonstrate that CoSA-generated schedules significantly outperform state-of-the-art approaches by a geometric mean of up to 2.5x across a wide range of DNN networks while improving the time-to-solution by 90x.


title: MiCE: Mixture of Contrastive Experts for Unsupervised Image Clustering

abstract: We present Mixture of Contrastive Experts (MiCE), a unified probabilistic clustering framework that simultaneously exploits the discriminative representations learned by contrastive learning and the semantic structures captured by a latent mixture model. Motivated by the mixture of experts, MiCE employs a gating function to partition an unlabeled dataset into subsets according to the latent semantics and multiple experts to discriminate distinct subsets of instances assigned to them in a contrastive learning manner. To solve the nontrivial inference and learning problems caused by the latent variables, we further develop a scalable variant of the Expectation-Maximization (EM) algorithm for MiCE and provide proof of the convergence. Empirically, we evaluate the clustering performance of MiCE on four widely adopted natural image datasets. MiCE achieves significantly better results than various previous methods and a strong contrastive learning baseline.


title: Visible-Infrared spectroscopy of ungrouped and rare meteorites brings further constraints on meteorite-asteroid connections

abstract: Although spectral surveys and spacecraft missions provide information on small bodies, many important analyses can only be performed in terrestrial laboratories. For now, the total number of parent bodies represented in our meteorites collection is estimated to about 150 parent bodies, of which 50 parent bodies represented by the poorly studied ungrouped chondrites. Linking ungrouped meteorites to their parent bodies is thus crucial to significantly increase our knowledge of asteroids. To this end, the petrography of 25 ungrouped chondrites and rare meteorite groups was studied, allowing grouping into 6 petrographic groups based on texture, mineralogy, and aqueous and thermal parent body processing. Then, we acquired visible-near-infrared reflectance spectroscopy data, in order to compare them to ground-based telescopic observations of asteroids. The reflectance spectra of meteorites were obtained on powdered samples, raw samples and polished sections. Our results showed that sample preparation influences the shape of the spectra, and thus asteroid spectral matching, especially for carbonaceous chondrites. Overall, the petrographic groups defined initially coincide with reflectance spectral groups. We define links between some of the studied ungrouped chondrites and asteroid types that had no meteorite connection proposed before, such as some very primitive type 3.00 ungrouped chondrites to B-type or Cg-type asteroids. We also matched metamorphosed ungrouped carbonaceous chondrites to S-complex asteroids, suggesting that this complex is not only composed of ordinary chondrites or primitive achondrites, as previously established, but may also host carbonaceous chondrites. Conversely, some ungrouped chondrites could not be matched to any known asteroid type, showing that those are potential samples from yet unidentified asteroid types.


title: Impact of channel access and transport mechanisms on QoE in GEO-satellite based LTE backhauling systems

abstract: Backhauling services through satellite systems have doubled between 2012 and 2018. There is an increasing demand for this service for which satellite systems typically allocate a fixed resource. This solution may not help in optimizing the usage of the scarce satellite resource. This study measures the relevance of using dynamic resource allocation mechanisms for backhaul services through satellite systems. The satellite system is emulated with OpenSAND, the LTE system with Amarisoft and the experiments are orchestrated by OpenBACH. We compare the relevance of applying TCP PEP mechanisms and dynamic resource allocations for different traffic services by measuring the QoE for web browsing, data transfer and VoIP applications. The main conclusions are the following. When the system is congested, PEP and layer-2 access mechanisms do not provide significant improvements. When the system is not congested, data transfer can be greatly improved through protocols and channel access mechanism optimization. Tuning the Constant Rate Assignment can help in reducing the cost of the resource and provide QoE improvements when the network is not loaded.


title: Formally Justifying MDL-based Inference of Cause and Effect

abstract: The algorithmic independence of conditionals, which postulates that the causal mechanism is algorithmically independent of the cause, has recently inspired many highly successful approaches to distinguish cause from effect given only observational data. Most popular among these is the idea to approximate algorithmic independence via two-part Minimum Description Length (MDL). Although intuitively sensible, the link between the original postulate and practical two-part MDL encodings is left vague. In this work, we close this gap by deriving a two-part formulation of this postulate, in terms of Kolmogorov complexity, which directly links to practical MDL encodings. To close the cycle, we prove that this formulation leads on expectation to the same inference result as the original postulate.


title: Using Synthetic Data to Enhance the Accuracy of Fingerprint-Based Localization: A Deep Learning Approach

abstract: Human-centered data collection is typically costly and implicates issues of privacy. Various solutions have been proposed in the literature to reduce this cost, such as crowdsourced data collection, or the use of semi-supervised algorithms. However, semi-supervised algorithms require a source of unlabeled data, and crowd-sourcing methods require numbers of active participants. An alternative passive data collection modality is fingerprint-based localization. Such methods use received signal strength (RSS) or channel state information (CSI) in wireless sensor networks to localize users in indoor/outdoor environments. In this paper, we introduce a novel approach to reduce training data collection costs in fingerprint-based localization by using synthetic data. Generative adversarial networks (GANs) are used to learn the distribution of a limited sample of collected data and, following this, to produce synthetic data that can be used to augment the real collected data in order to increase overall positioning accuracy. Experimental results on a benchmark dataset show that by applying the proposed method and using a combination of 10% collected data and 90% synthetic data, we can obtain essentially similar positioning accuracy to that which would be obtained by using the full set of collected data. This means that by employing GAN-generated synthetic data, we can use 90% less real data, thereby reduce data-collection costs while achieving acceptable accuracy.


title: Solving Sokoban with forward-backward reinforcement learning

abstract: Despite seminal advances in reinforcement learning in recent years, many domains where the rewards are sparse, e.g. given only at task completion, remain quite challenging. In such cases, it can be beneficial to tackle the task both from its beginning and end, and make the two ends meet. Existing approaches that do so, however, are not effective in the common scenario where the strategy needed near the end goal is very different from the one that is effective earlier on. In this work we propose a novel RL approach for such settings. In short, we first train a backward-looking agent with a simple relaxed goal, and then augment the state representation of the forward-looking agent with straightforward hint features. This allows the learned forward agent to leverage information from backward plans, without mimicking their policy. We demonstrate the efficacy of our approach on the challenging game of Sokoban, where we substantially surpass learned solvers that generalize across levels, and are competitive with SOTA performance of the best highly-crafted systems. Impressively, we achieve these results while learning from a small number of practice levels and using simple RL techniques.


title: 4DComplete: Non-Rigid Motion Estimation Beyond the Observable Surface

abstract: Tracking non-rigidly deforming scenes using range sensors has numerous applications including computer vision, AR/VR, and robotics. However, due to occlusions and physical limitations of range sensors, existing methods only handle the visible surface, thus causing discontinuities and incompleteness in the motion field. To this end, we introduce 4DComplete, a novel data-driven approach that estimates the non-rigid motion for the unobserved geometry. 4DComplete takes as input a partial shape and motion observation, extracts 4D time-space embedding, and jointly infers the missing geometry and motion field using a sparse fully-convolutional network. For network training, we constructed a large-scale synthetic dataset called DeformingThings4D, which consists of 1972 animation sequences spanning 31 different animals or humanoid categories with dense 4D annotation. Experiments show that 4DComplete 1) reconstructs high-resolution volumetric shape and motion field from a partial observation, 2) learns an entangled 4D feature representation that benefits both shape and motion estimation, 3) yields more accurate and natural deformation than classic non-rigid priors such as As-Rigid-As-Possible (ARAP) deformation, and 4) generalizes well to unseen objects in real-world sequences.


title: Can gravitational waves halt the expansion of the universe?

abstract: We numerically investigate the propagation of plane gravitational waves in the form of an initial boundary value problem with de Sitter initial data. The full non-linear Einstein equations with positive cosmological constant $\lambda$ are written in the Friedrich-Nagy gauge which yields a wellposed system. The propagation of a single wave and the collision of two with colinear polarization are studied and contrasted with their Minkowskian analogues. Unlike with $\lambda=0$, critical behaviours are found with $\lambda>0$ and are based on the relationship between the wave profile and $\lambda$. We find that choosing boundary data close to one of these bifurcations results in a "false" steady state which violates the constraints. Simulations containing (approximate) impulsive wave profiles are run and general features are discussed. Analytic results of Woodard and Tsamis, which describe how gravitational waves could affect an expansion rate at an initial instance of time, are explored and generalized to the entire space-time. Finally we put forward boundary conditions that, at least locally, slow down the expansion considerably for a time.


title: Using graphene conductors to enhance the functionality of atom-chips

abstract: We show that the performance and functionality of atom-chips can be transformed by using graphene-based van der Waals heterostructures to overcome present limitations on the lifetime of the trapped atom cloud and on its proximity to the chip surface. Our analysis involves Green-function calculations of the thermal (Johnson) noise and Casimir-Polder atom-surface attraction produced by the atom-chip. This enables us to determine the lifetime limitations produced by spin-flip, tunneling and three-body collisional losses. Compared with atom-chips that use thick metallic conductors and substrates, atom-chip structures based on two-dimensional materials reduce the minimum attainable atom-surface separation to a few 100 nm and increase the lifetimes of the trapped atom clouds by orders of magnitude so that they are limited only by the quality of the background vacuum. We predict that atom-chips with two-dimensional conductors will also reduce spatial fluctuations in the trapping potential originating from imperfections in the conductor patterns. These advantages will enhance the performance of atom-chips for quantum sensing applications and for fundamental studies of complex quantum systems.


title: Improved current reference calculation for MMCs interal energy balancing control

abstract: The paper addresses an improved inner current reference calculation to be employed in the control of modular multilevel converters operating during either balanced or unbalanced conditions. The suggested reference calculation is derived based on the AC and DC additive and differential voltage components applied to the upper and lower arms of the converter. In addition, the impacts caused not only by the AC network's impedances but also by the MMC's arm impedances are also considered during the derivation of the AC additive current reference expressions. Another issue discussed in this article regards that singular voltage conditions, where the positive-sequence component is equal to the negative one, may occur not only in the AC network but also internally (within the converter's applied voltages). Several different inner current reference calculation methods are compared and their applicability during the former fault conditions is analyzed. The paper presents a detailed formulation of the inner current reference calculation and applies it to different unbalanced AC grid faults where it is shown that the presented approach can be potentially used to maintain the internal energy of the converter balanced during normal and fault conditions.


title: A discontinuous least squares finite element method for Helmholtz equations

abstract: We propose a discontinuous least squares finite element method for solving the Helmholtz equation. The method is based on the L2 norm least squares functional with the weak imposition of the continuity across the interior faces as well as the boundary conditions. We minimize the functional over the discontinuous polynomial spaces to seek numerical solutions. The wavenumber explicit error estimates to our method are established. The optimal convergence rate in the energy norm with respect to a fixed wavenumber is attained. The least squares functional can naturally serve as a posteriori estimator in the h-adaptive procedure. It is convenient to implement the code due to the usage of discontinuous elements. Numerical results in two and three dimensions are presented to verify the error estimates.


title: LEADOR: A Method for End-to-End Participatory Design of Autonomous Social Robots

abstract: Participatory Design (PD) in Human-Robot Interaction (HRI) typically remains limited to the early phases of development, with subsequent robot behaviours then being hardcoded by engineers or utilised in Wizard-of-Oz (WoZ) systems that rarely achieve autonomy. We present LEADOR (Led-by-Experts Automation and Design Of Robots) an end-to-end PD methodology for domain expert co-design, automation and evaluation of social robots. LEADOR starts with typical PD to co-design the interaction specifications and state and action space of the robot. It then replaces traditional offline programming or WoZ by an in-situ, online teaching phase where the domain expert can live-program or teach the robot how to behave while being embedded in the interaction context. We believe that this live teaching can be best achieved by adding a learning component to a WoZ setup, to capture experts' implicit knowledge, as they intuitively respond to the dynamics of the situation. The robot progressively learns an appropriate, expert-approved policy, ultimately leading to full autonomy, even in sensitive and/or ill-defined environments. However, LEADOR is agnostic to the exact technical approach used to facilitate this learning process. The extensive inclusion of the domain expert(s) in robot design represents established responsible innovation practice, lending credibility to the system both during the teaching phase and when operating autonomously. The combination of this expert inclusion with the focus on in-situ development also means LEADOR supports a mutual shaping approach to social robotics. We draw on two previously published, foundational works from which this (generalisable) methodology has been derived in order to demonstrate the feasibility and worth of this approach, provide concrete examples in its application and identify limitations and opportunities when applying this framework in new environments.


title: A 4565 Myr old andesite from an extinct chondritic protoplanet

abstract: The age of iron meteorites implies that accretion of protoplanets began during the first millions of years of the solar system. Due to the heat generated by 26Al decay, many early protoplanets were fully differentiated with an igneous crust produced during the cooling of a magma ocean and the segregation at depth of a metallic core. The formation and nature of the primordial crust generated during the early stages of melting is poorly understood, due in part to the scarcity of available samples. The newly discovered meteorite Erg Chech 002 (EC 002) originates from one such primitive igneous crust and has an andesite bulk composition. It derives from the partial melting of a noncarbonaceous chondritic reservoir, with no depletion in alkalis relative to the Sun photosphere and at a high degree of melting of around 25 percents. Moreover, EC 002 is, to date, the oldest known piece of an igneous crust with a 26Al-26Mg crystallization age of 4,565.0 million years (My). Partial melting took place at 1,220 C up to several hundred kyr before, implying an accretion of the EC 002 parent body ca. 4,566 My ago. Protoplanets covered by andesitic crusts were probably frequent. However, no asteroid shares the spectral features of EC 002, indicating that almost all of these bodies have disappeared, either because they went on to form the building blocks of larger bodies or planets or were simply destroyed.


title: Origins of colors variability among C-cluster main-belt asteroids

abstract: The Sloan Digital Sky Survey provides colors for more than 100 000 moving objects, among which around 10 000 have albedos determined. Here we combined colors and albedo in order to perform a cluster analysis on the small bodies population, and identify a C-cluster, a group of asteroid related to C-type as defined in earlier work. Members of this C-cluster are in fair agreement with the color boundaries of B and C-type defined in DeMeo and Carry (2013). We then compare colors of C-cluster asteroids to those of carbonaceous chondrites powders, while taking into account the effect of phase angle. We show that only CM chondrites have colors in the range of C-cluster asteroids, CO, CR and CV chondrites being significantly redder. Also, CM chondrites powders are on average slightly redder than the average C-cluster. The colors of C-cluster members are further investigated by looking at color variations as a function of asteroid diameter. We observe that the visible slope becomes bluer with decreasing asteroids diameter, and a transition seems to be present around 20 km. We discuss the origin of this variation and, if not related to a bias in the dataset - analysis, we conclude that it is related to the surface texture of the objects, smaller objects being covered by rocks, while larger objects are covered by a particulate surface. The blueing is interpreted by an increased contribution of the first reflection in the case of rock-dominated surfaces, which can scatter light in a Rayleigh-like manner. We do not have unambiguous evidence of space weathering within the C-cluster based on this analysis, however the generally bluer nature of C-cluster objects compared to CM chondrites could be to some extent related to space weathering.


title: Identifying hidden coalitions in the US House of Representatives by optimally partitioning signed networks based on generalized balance

abstract: In network science, identifying optimal partitions of a signed network into internally cohesive and mutually divisive clusters based on generalized balance theory is computationally challenging. We reformulate and generalize two binary linear programming models that tackle this challenge, demonstrating their practicality by applying them them to partition networks of collaboration in the US House of Representatives. These models guarantee a globally optimal network partition and can be practically applied to signed networks containing up to 30,000 edges. In the US House context, we find that a three-cluster partition is better than a conventional two-cluster partition, where the otherwise hidden third coalition is composed of highly effective legislators who are ideologically aligned with the majority party.


title: Isomorphic Boolean networks and dense interaction graphs

abstract: A Boolean network (BN) with $n$ components is a discrete dynamical system described by the successive iterations of a function $f:\{0,1\}^n\to\{0,1\}^n$. In most applications, the main parameter is the interaction graph of $f$: the digraph with vertex set $\{1,\dots,n\}$ that contains an arc from $j$ to $i$ if $f_i$ depends on input $j$. What can be said on the set $\mathcal{G}(f)$ of the interaction graphs of the BNs $h$ isomorphic to $f$, that is, such that $h\circ \pi=\pi\circ f$ for some permutation $\pi$ of $\{0,1\}^n$? It seems that this simple question has never been studied. Here, we report some basic facts. First, if $n\geq 5$ and $f$ is neither the identity or constant, then $\mathcal{G}(f)$ is of size at least two and contains the complete digraph on $n$ vertices, with $n^2$ arcs. Second, for any $n\geq 1$, there are $n$-component BNs $f$ such that every digraph in $\mathcal{G}(f)$ has at least $n^2/9$ arcs.


title: Long-term stellar activity variations and their effect on radial-velocity measurements

abstract: Long-term stellar activity variations can affect the detectability of long-period and Earth-analogue extrasolar planets. We have, for 54 stars, analysed the long-term trend of five activity indicators: log$R'_\mathrm{{HK}}$, the cross-correlation function (CCF) bisector span, CCF full-width-at-half-maximum, CCF contrast, and the area of the Gaussian fit to the CCF; and studied their correlation with the RVs. The sign of the correlations appears to vary as a function of stellar spectral type, and the transition in sign signals a noteworthy change in the stellar activity properties where earlier type stars appear more plage dominated. These transitions become more clearly defined when considered as a function of the convective zone depth. Therefore, it is the convective zone depth (which can be altered by stellar metallicity) that appears to be the underlying fundamental parameter driving the observed activity correlations. In addition, for most of the stars, we find that the RVs become increasingly red-shifted as activity levels increase, which can be explained by the increase in the suppression of convective blue-shift. However, we also find a minority of stars where the RVs become increasingly blue-shifted as activity levels increase. Finally, using the correlation found between activity indicators and RVs, we removed RV signals generated by long-term changes in stellar activity. We find that performing simple cleaning of such long-term signals enables improved planet detection at longer orbital periods.


title: $2\times n$ Grids have Unbounded Anagram-Free Chromatic Number

abstract: We show that anagram-free vertex colouring a $2\times n$ square grid requires a number of colours that increases with $n$. This answers an open question in Wilson's thesis and shows that even graphs of pathwidth $2$ do not have anagram-free colourings with a bounded number of colours.


title: Sets of Exact Approximation Order by Complex rational numbers

abstract: For a nonincreasing function $\psi$, let $\textrm{Exact}(\psi)$ be the set of complex numbers that are approximable by complex rational numbers to order $\psi$ but to no better order. In this paper, we obtain the Hausdorff dimension and packing dimension of $\textrm{Exact}(\psi)$ when $\psi(x)=o(x^{-2})$. We also prove that the lower bound of the Hausdorff dimension is greater than $2-\tau/(1-2\tau)$ when $\tau=\limsup_{x\to\infty}\psi(x)x^2$ small enough.


title: Collective enhancement of above threshold ionization by resonantly excited helium nanodroplets

abstract: Clusters and nanodroplets hold the promise of enhancing high-order nonlinear optical effects due to their high local density. However, only moderate enhancement has been demonstrated to date. Here, we report the observation of energetic electrons generated by above-threshold ionization (ATI) of helium (He) nanodroplets which are resonantly excited by ultrashort extreme ultraviolet (XUV) free-electron laser pulses and subsequently ionized by near-infrared (NIR) or near-ultraviolet (UV) pulses. The electron emission due to high-order ATI is enhanced by several orders of magnitude compared to He atoms. The crucial dependence of the ATI intensities with the number of excitations in the droplets suggests a local collective enhancement effect.


title: Weakly Supervised Pseudo-Label assisted Learning for ALS Point Cloud Semantic Segmentation

abstract: Competitive point cloud semantic segmentation results usually rely on a large amount of labeled data. However, data annotation is a time-consuming and labor-intensive task, particularly for three-dimensional point cloud data. Thus, obtaining accurate results with limited ground truth as training data is considerably important. As a simple and effective method, pseudo labels can use information from unlabeled data for training neural networks. In this study, we propose a pseudo-label-assisted point cloud segmentation method with very few sparsely sampled labels that are normally randomly selected for each class. An adaptive thresholding strategy was proposed to generate a pseudo-label based on the prediction probability. Pseudo-label learning is an iterative process, and pseudo labels were updated solely on ground-truth weak labels as the model converged to improve the training efficiency. Experiments using the ISPRS 3D sematic labeling benchmark dataset indicated that our proposed method achieved an equally competitive result compared to that using a full supervision scheme with only up to 2$\unicode{x2030}$ of labeled points from the original training set, with an overall accuracy of 83.7% and an average F1 score of 70.2%.


title: Accent Recognition with Hybrid Phonetic Features

abstract: The performance of voice-controlled systems is usually influenced by accented speech. To make these systems more robust, the frontend accent recognition (AR) technologies have received increased attention in recent years. As accent is a high-level abstract feature that has a profound relationship with the language knowledge, AR is more challenging than other language-agnostic audio classification tasks. In this paper, we use an auxiliary automatic speech recognition (ASR) task to extract language-related phonetic features. Furthermore, we propose a hybrid structure that incorporates the embeddings of both a fixed acoustic model and a trainable acoustic model, making the language-related acoustic feature more robust. We conduct several experiments on the Accented English Speech Recognition Challenge (AESRC) 2020 dataset. The results demonstrate that our approach can obtain a 6.57% relative improvement on the validation set. We also get a 7.28% relative improvement on the final test set for this competition, showing the merits of the proposed method.


title: Unravelled Abstract Regular Polytopes

abstract: This paper introduces the notion of an unravelled abstract regular polytope, and proves that $\SL_3(q) \rtimes <t>$, where $t$ is the transpose inverse automorphism of $\SL_3(q)$, possesses such polytopes for various congruences of $q$. A large number of small examples of such polytopes are given, along with extensive details of their various properties.


title: SeaDronesSee: A Maritime Benchmark for Detecting Humans in Open Water

abstract: Unmanned Aerial Vehicles (UAVs) are of crucial importance in search and rescue missions in maritime environments due to their flexible and fast operation capabilities. Modern computer vision algorithms are of great interest in aiding such missions. However, they are dependent on large amounts of real-case training data from UAVs, which is only available for traffic scenarios on land. Moreover, current object detection and tracking data sets only provide limited environmental information or none at all, neglecting a valuable source of information. Therefore, this paper introduces a large-scaled visual object detection and tracking benchmark (SeaDronesSee) aiming to bridge the gap from land-based vision systems to sea-based ones. We collect and annotate over 54,000 frames with 400,000 instances captured from various altitudes and viewing angles ranging from 5 to 260 meters and 0 to 90 degrees while providing the respective meta information for altitude, viewing angle and other meta data. We evaluate multiple state-of-the-art computer vision algorithms on this newly established benchmark serving as baselines. We provide an evaluation server where researchers can upload their prediction and compare their results on a central leaderboard


title: snpQT: flexible, reproducible, and comprehensive quality control and imputation of genomic data

abstract: Motivation: Quality control of genomic data is an essential but complicated multi-step procedure, often requiring separate installation and expert familiarity with a combination of disparate bioinformatics tools. Results: To provide an automated solution that retains comprehensive quality checks and flexible workflow architecture, we have developed snpQT, a scalable, stand-alone software pipeline, offering some 36 discrete quality filters or correction steps, with plots before-and-after user-modifiable thresholding. This includes build conversion, population stratification against 1,000 Genomes data, population outlier removal, and built-in imputation with its own pre- and post- quality controls. Common input formats are used and users need not be superusers nor have any prior coding experience. A comprehensive online tutorial and installation guide is provided through to GWAS (https://snpqt.readthedocs.io/en/latest/), introducing snpQT using a synthetic demonstration dataset and a real-world Amyotrophic Lateral Sclerosis SNP-array dataset. Availability: snpQT is open source and freely available at https://github.com/nebfield/snpQT Contact: Vasilopoulou-C@ulster.ac.uk, w.duddy@ulster.ac.uk


title: Novelty Detection and Analysis of Traffic Scenario Infrastructures in the Latent Space of a Vision Transformer-Based Triplet Autoencoder

abstract: Detecting unknown and untested scenarios is crucial for scenario-based testing. Scenario-based testing is considered to be a possible approach to validate autonomous vehicles. A traffic scenario consists of multiple components, with infrastructure being one of it. In this work, a method to detect novel traffic scenarios based on their infrastructure images is presented. An autoencoder triplet network provides latent representations for infrastructure images which are used for outlier detection. The triplet training of the network is based on the connectivity graphs of the infrastructure. By using the proposed architecture, expert-knowledge is used to shape the latent space such that it incorporates a pre-defined similarity in the neighborhood relationships of an autoencoder. An ablation study on the architecture is highlighting the importance of the triplet autoencoder combination. The best performing architecture is based on vision transformers, a convolution-free attention-based network. The presented method outperforms other state-of-the-art outlier detection approaches.


title: Commonsense Knowledge Base Construction in the Age of Big Data

abstract: Compiling commonsense knowledge is traditionally an AI topic approached by manual labor. Recent advances in web data processing have enabled automated approaches. In this demonstration we will showcase three systems for automated commonsense knowledge base construction, highlighting each time one aspect of specific interest to the data management community. (i) We use Quasimodo to illustrate knowledge extraction systems engineering, (ii) Dice to illustrate the role that schema constraints play in cleaning fuzzy commonsense knowledge, and (iii) Ascent to illustrate the relevance of conceptual modelling. The demos are available online at https://quasimodo.r2.enst.fr, https://dice.mpi-inf.mpg.de and ascent.mpi-inf.mpg.de.


title: Bismut-Cheeger eta form and higher spectral flow

abstract: In this paper, using the equivariant version of the Dai-Zhang higher spectral flow, we generalize the variation formula, embedding formula and the adiabatic limit formula for the Atiyah-Patodi-Singer eta invariants to the equivariant Bismut-Cheeger eta forms for a fiberwise compact Lie group action when the kernels of corresponding fiberwise Dirac operators form equivariant vector bundles.


title: Reconciling ionization energies and band gaps of warm dense matter derived with ab initio simulations and average atom models

abstract: Average atom (AA) models allow one to efficiently compute electronic and optical properties of materials over a wide range of conditions and are often employed to interpret experimental data. However, at high pressure, predictions from AA models have been shown to disagree with results from ab initio computer simulations. Here we reconcile these deviations by developing an innovative type of AA model, AVION, that computes the electronic eigenstates with novel boundary conditions within the ion sphere. Bound and free states are derived consistently. We drop the common AA image that the free-particle spectrum starts at the potential threshold, which we found to be incompatible with ab initio calculations. We perform ab initio simulations of crystalline and liquid carbon and aluminum over a wide range of densities and show that the computed band structure is in very good agreement with predictions from AVION.


title: Instances as Queries

abstract: Recently, query based object detection frameworks achieve comparable performance with previous state-of-the-art object detectors. However, how to fully leverage such frameworks to perform instance segmentation remains an open problem. In this paper, we present QueryInst (Instances as Queries), a query based instance segmentation method driven by parallel supervision on dynamic mask heads. The key insight of QueryInst is to leverage the intrinsic one-to-one correspondence in object queries across different stages, as well as one-to-one correspondence between mask RoI features and object queries in the same stage. This approach eliminates the explicit multi-stage mask head connection and the proposal distribution inconsistency issues inherent in non-query based multi-stage instance segmentation methods. We conduct extensive experiments on three challenging benchmarks, i.e., COCO, CityScapes, and YouTube-VIS to evaluate the effectiveness of QueryInst in instance segmentation and video instance segmentation (VIS) task. Specifically, using ResNet-101-FPN backbone, QueryInst obtains 48.1 box AP and 42.8 mask AP on COCO test-dev, which is 2 points higher than HTC in terms of both box AP and mask AP, while runs 2.4 times faster. For video instance segmentation, QueryInst achieves the best performance among all online VIS approaches and strikes a decent speed-accuracy trade-off. Code is available at \url{https://github.com/hustvl/QueryInst}.


title: XAI-KG: knowledge graph to support XAI and decision-making in manufacturing

abstract: The increasing adoption of artificial intelligence requires accurate forecasts and means to understand the reasoning of artificial intelligence models behind such a forecast. Explainable Artificial Intelligence (XAI) aims to provide cues for why a model issued a certain prediction. Such cues are of utmost importance to decision-making since they provide insights on the features that influenced most certain forecasts and let the user decide if the forecast can be trusted. Though many techniques were developed to explain black-box models, little research was done on assessing the quality of those explanations and their influence on decision-making. We propose an ontology and knowledge graph to support collecting feedback regarding forecasts, forecast explanations, recommended decision-making options, and user actions. This way, we provide means to improve forecasting models, explanations, and recommendations of decision-making options. We tailor the knowledge graph for the domain of demand forecasting and validate it on real-world data.


title: Constraining the ratio of median pixel optical depth profile around z ~ 4 quasars using the longitudinal proximity effect

abstract: We present a detailed study of the longitudinal proximity effect using a sample of 85 quasars spanning an emission redshift range of $3.5 \leq z_{em} \leq 4.5$ and Lyman continuum luminosity ($L_{912}$) ranging from 1.06$\times 10^{31}$ to 2.24$\times 10^{32}$ erg s$^{-1}$ Hz$^{-1}$. We use the high-quality spectra of these quasars obtained at a spectral resolution of $R\sim$ 5100 and S/N $\sim$ 30 using X-SHOOTER spectrograph mounted on the Very Large Telescope (VLT). In our analysis, we compared the transmitted flux and pixel optical depth of the Ly$\alpha$ absorption originating from the vicinity of quasars to those from the general intergalactic medium by using a redshift matched control sample. The longitudinal proximity effect is found up to $r \leq 12$ Mpc (proper) from quasars. By appropriately scaling up the pixel optical depth in the vicinity of quasars to account for the excess ionization by quasars, we constrain the ratio of median HI optical depth in the vicinity of the quasar to that of the IGM ($R_\tau(r)$). The $R_\tau (r)$ is found to be significantly higher than unity up to 6 Mpc from the quasar with a typical radial profile of the form $R_\tau(r) = 1+A \times exp(-r/r_0)$ with $A=9.16\pm 0.68$ and $r_0= 1.27\pm 0.08$ Mpc. The integrated value of the scaled pixel optical depth over the radial bin of 0-6 Mpc is found to be higher by a factor of $2.55 \pm 0.17$ than the corresponding integrated value of the median pixel optical depth of the IGM. We also found $R_\tau (r)$ to be luminosity dependent.


title: Centralities in complex networks

abstract: In network science complex systems are represented as a mathematical graphs consisting of a set of nodes representing the components and a set of edges representing their interactions. The framework of networks has led to significant advances in the understanding of the structure, formation and function of complex systems. Social and biological processes such as the dynamics of epidemics, the diffusion of information in social media, the interactions between species in ecosystems or the communication between neurons in our brains are all actively studied using dynamical models on complex networks. In all of these systems, the patterns of connections at the individual level play a fundamental role on the global dynamics and finding the most important nodes allows one to better understand and predict their behaviors. An important research effort in network science has therefore been dedicated to the development of methods allowing to find the most important nodes in networks. In this short entry, we describe network centrality measures based on the notions of network traversal they rely on. This entry aims at being an introduction to this extremely vast topic, with many contributions from several fields, and is by no means an exhaustive review of all the literature about network centralities.


title: Concentrated solutions to fractional Schr\"odinger equations with prescribed $L^2$-norm

abstract: We investigate the existence and local uniqueness of normalized $k$-peak solutions for the fractional Schr\"odinger equations with attractive interactions with a class of degenerated trapping potential with non-isolated critical points. Precisely, applying the finite dimensional reduction method, we first obtain the existence of $k$-peak concentrated solutions and especially describe the relationship between the chemical potential $\mu$ and the attractive interaction $a$. Second, after precise analysis of the concentrated points and the Lagrange multiplier, we prove the local uniqueness of the $k$-peak solutions with prescribed $L^2$-norm, by use of the local Pohozaev identities, the blow-up analysis and the maximum principle associated to the nonlocal operator $(-\Delta)^s$. To our best knowledge, there is few results on the excited normalized solutions of the fractional Schr\"odinger equations before this present work. The main difficulty lies in the non-local property of the operator $(-\Delta)^s$. First, it makes the standard comparison argument in the ODE theory invalid to use in our analysis. Second, because of the algebraic decay involving the approximate solutions, the estimates, on the Lagrange multiplier for example, would become more subtle. Moreover,when studying the corresponding harmonic extension problem, several local Pohozaev identities are constructed and we have to estimate several kinds of integrals that never appear in the classic local Schr\"odinger problems. In addition, throughout our discussion, we need to distinct the different cases of $p$, which are called respectively that the mass-subcritical, the mass-critical, and the mass-supercritical case, due to the mass-constraint condition. Another difficulty comes from the influence of the different degenerate rates along different directions at the critical points of the potential.


title: Automated scoring of pre-REM sleep in mice with deep learning

abstract: Reliable automation of the labor-intensive manual task of scoring animal sleep can facilitate the analysis of long-term sleep studies. In recent years, deep-learning-based systems, which learn optimal features from the data, increased scoring accuracies for the classical sleep stages of Wake, REM, and Non-REM. Meanwhile, it has been recognized that the statistics of transitional stages such as pre-REM, found between Non-REM and REM, may hold additional insight into the physiology of sleep and are now under vivid investigation. We propose a classification system based on a simple neural network architecture that scores the classical stages as well as pre-REM sleep in mice. When restricted to the classical stages, the optimized network showed state-of-the-art classification performance with an out-of-sample F1 score of 0.95 in male C57BL/6J mice. When unrestricted, the network showed lower F1 scores on pre-REM (0.5) compared to the classical stages. The result is comparable to previous attempts to score transitional stages in other species such as transition sleep in rats or N1 sleep in humans. Nevertheless, we observed that the sequence of predictions including pre-REM typically transitioned from Non-REM to REM reflecting sleep dynamics observed by human scorers. Our findings provide further evidence for the difficulty of scoring transitional sleep stages, likely because such stages of sleep are under-represented in typical data sets or show large inter-scorer variability. We further provide our source code and an online platform to run predictions with our trained network.


title: The Lifshitz nature of the transition between the gap and gapless states of a superconductor

abstract: It is demonstrated that the known for a long time transition between the gap and the gapless states in the Abrikosov-Gor'kov theory of a superconductor with paramagnetic impurities is of the Lifshitz type, i.e. of the $2\frac12$ order phase transition. We reveal the emergence of a cuspidal edge at the density of states surface $N(\omega,\Delta_0)$ ($\Delta_0$ is the value of the superconducting order parameter in the absence of magnetic impurities) and the occurrence of the catastrophe phenomenon at the transition point. We study the stability of such a transition with respect to the spatial fluctuations of the magnetic impurities critical concentration $n_s$ and show that the requirement for validity of its mean field description is unobtrusive: $\nabla \left( {\ln {n_s}} \right) \ll \xi^{-1} $ (here $\xi$ is the superconducting coherence length). Finally, we show that, similarly to the Lifshitz point, the $2\frac12$ order phase transition should be accompanied by the corresponding singularities. For instance, the superconducting thermoelectric effect has a giant peak exceeding the normal value of the Seebeck coefficient by the ratio of the Fermi energy and the superconducting gap. The concept of the experiment for the confirmation of $2\frac12$ order transition nature is proposed. The obtained theoretical results can be applied for the explanation of recent experiments with lightwave-driven gapless superconductivity, for the new interpretation of the disorder induced transition $s_{\pm}$-$s_{++}$ states via gapless state in multi-band superconductors, for better understanding of the gapless color superconductivity in quantum chromodynamics, the string theory.


title: Energy Spectrum of Thermalizing High Energy Decay Products in the Early Universe

abstract: We revisit the Boltzmann equation governing the spectrum of energetic particles originating from the decay of massive progenitors during the process of thermalization. We assume that these decays occur when the background temperature $T$ is much less than the mass $M$ of the progenitor. We pay special attention to the IR cutoff provided by the thermal bath, and include the suppression resulting from the interference of multiple scattering reactions (LPM effect). We solve the resulting integral equation numerically, and construct an accurate analytical fit of the solutions.


title: From Kajihara's transformation formula to deformed Macdonald-Ruijsenaars and Noumi-Sano operators

abstract: Kajihara obtained in 2004 a remarkable transformation formula connecting multiple basic hypergeometric series associated with $A$-type root systems of different ranks. By multiple principle specialisations of his formula, we deduce kernel identities for deformed Macdonald-Ruijsenaars (MR) and Noumi-Sano (NS) operators. The deformed MR operators were introduced by Sergeev and Veselov in the first order case and by Feigin and Silantyev in the higher order cases. As applications of our kernel identities, we prove that all of these operators pairwise commute and are simultaneously diagonalised by the super-Macdonald polynomials. We also provide an explicit description of the algebra generated by the deformed MR and/or NS operators by a Harish-Chandra type isomorphism and show that the deformed MR (NS) operators can be viewed as restrictions of inverse limits of ordinary MR (NS) operators.


title: FLEX: Extrinsic Parameters-free Multi-view 3D Human Motion Reconstruction

abstract: The increasing availability of video recordings made by multiple cameras has offered new means for mitigating occlusion and depth ambiguities in pose and motion reconstruction methods. Yet, multi-view algorithms strongly depend on camera parameters; particularly, the relative transformations between the cameras. Such a dependency becomes a hurdle once shifting to dynamic capture in uncontrolled settings. We introduce FLEX (Free muLti-view rEconstruXion), an end-to-end extrinsic parameter-free multi-view model. FLEX is extrinsic parameter-free (dubbed ep-free) in the sense that it does not require extrinsic camera parameters. Our key idea is that the 3D angles between skeletal parts, as well as bone lengths, are invariant to the camera position. Hence, learning 3D rotations and bone lengths rather than locations allows predicting common values for all camera views. Our network takes multiple video streams, learns fused deep features through a novel multi-view fusion layer, and reconstructs a single consistent skeleton with temporally coherent joint rotations. We demonstrate quantitative and qualitative results on three public datasets, and on synthetic multi-person video streams captured by dynamic cameras. We compare our model to state-of-the-art methods that are not ep-free and show that in the absence of camera parameters, we outperform them by a large margin while obtaining comparable results when camera parameters are available. Code, trained models, and other materials are available on our project page.


title: Towards Self-Supervision for Video Identification of Individual Holstein-Friesian Cattle: The Cows2021 Dataset

abstract: In this paper we publish the largest identity-annotated Holstein-Friesian cattle dataset Cows2021 and a first self-supervision framework for video identification of individual animals. The dataset contains 10,402 RGB images with labels for localisation and identity as well as 301 videos from the same herd. The data shows top-down in-barn imagery, which captures the breed's individually distinctive black and white coat pattern. Motivated by the labelling burden involved in constructing visual cattle identification systems, we propose exploiting the temporal coat pattern appearance across videos as a self-supervision signal for animal identity learning. Using an individual-agnostic cattle detector that yields oriented bounding-boxes, rotation-normalised tracklets of individuals are formed via tracking-by-detection and enriched via augmentations. This produces a `positive' sample set per tracklet, which is paired against a `negative' set sampled from random cattle of other videos. Frame-triplet contrastive learning is then employed to construct a metric latent space. The fitting of a Gaussian Mixture Model to this space yields a cattle identity classifier. Results show an accuracy of Top-1 57.0% and Top-4: 76.9% and an Adjusted Rand Index: 0.53 compared to the ground truth. Whilst supervised training surpasses this benchmark by a large margin, we conclude that self-supervision can nevertheless play a highly effective role in speeding up labelling efforts when initially constructing supervision information. We provide all data and full source code alongside an analysis and evaluation of the system.


title: Comparative Analysis of Box-Covering Algorithms for Fractal Networks

abstract: Research on fractal networks is a dynamically growing field of network science. A central issue is to analyze fractality with the so-called box-covering method. As this problem is known to be NP-hard, a plethora of approximating algorithms have been proposed throughout the years. This study aims to establish a unified framework for comparing approximating box-covering algorithms by collecting, implementing, and evaluating these methods in various aspects including running time and approximation ability. This work might also serve as a reference for both researchers and practitioners, allowing fast selection from a rich collection of box-covering algorithms with a publicly available codebase.

categories: cs.SI cs.DM physics.data-an physics.soc-ph


title: Strong diffusion approximation in averaging with dynamical systems fast motion

abstract: The paper deals with the fast-slow motions setups in the continuous time $\frac {dX^(t)}{dt}=\frac 1\varepsilon B(X^\varepsilon(t),\xi(t/\varepsilon^2))+b(X^\varepsilon(t),\,\xi(t/\varepsilon^2)),\, t\in [0,T]$ and the discrete time $X^\varepsilon((n+1)\varepsilon^2)=X^\varepsilon(n\varepsilon^2)+\varepsilon B(X^\varepsilon(n\varepsilon^2),\xi(n)) +\varepsilon^2 b(X^\varepsilon(n\varepsilon^2),\xi(n))$, $n=0,1,...,[T/\varepsilon^2]$ where $\Sigma$ and $b$ are smooth vector functions and $\xi$ is a stationary vector stochastic process such that $E\xi(0)=0$ for all $x\in\mathbb{R}^d$. Unlike \cite{Ki20} the assumptions imposed on the process $\xi$ allow applications to a wide class of observables $g$ in the dynamical systems setup so that $\xi$ can be taken in the form $\xi(t)=g(F^t\xi(0))$ or $\xi(n)=g(F^n\xi(0))$ where $F$ is either a flow or a diffeomorphism with some hyperbolicity and $g$ is a vector function. In this paper we show that both $X^\varepsilon$ and a family of diffusions $\Xi^\varepsilon$ can be redefined on a common sufficiently rich probability space so that $E\sup_{0\leq t\leq T}|X^\varepsilon(t)-\Xi^\varepsilon(t)|^{p}\leq C\varepsilon^\delta,\, p\geq 1$ for some $C,\delta>0$ and all $\varepsilon>0$, where all $\Xi^\varepsilon,\, \varepsilon>0$ have the same diffusion coefficients but underlying Brownian motions may change with $\varepsilon$.


title: Monotonicity-Based Regularization for Shape Reconstruction in Linear Elasticity

abstract: We deal with the shape reconstruction of inclusions in elastic bodies. For solving this inverse problem in practice, data fitting functionals are used. Those work better than the rigorous monotonicity methods from [5], but have no rigorously proven convergence theory. Therefore we show how the monotonicity methods can be converted into a regularization method for a data-fitting functional without losing the convergence properties of the monotonicity methods. This is a great advantage and a significant improvement over standard regularization techniques. In more detail, we introduce constraints on the minimization problem of the residual based on the monotonicity methods and prove the existence and uniqueness of a minimizer as well as the convergence of the method for noisy data. In addition, we compare numerical reconstructions of inclusions based on the monotonicity-based regularization with a standard approach (one-step linearization with Tikhonov-like regularization), which also shows the robustness of our method regarding noise in practice.


title: Reachability Analysis of Randomly Perturbed Hamiltonian Systems

abstract: In this paper, we revisit energy-based concepts of controllability and reformulate them for control-affine nonlinear systems perturbed by white noise. Specifically, we discuss the relation between controllability of deterministic systems and the corresponding stochastic control systems in the limit of small noise and in the case in which the target state is a measurable subset of the state space. We derive computable expression for hitting probabilities and mean first hitting times in terms of empirical Gramians, when the dynamics is given by a Hamiltonian system perturbed by dissipation and noise, and provide an easily computable expression for the corresponding controllability function as a function of a subset of the state variables.


title: NANOGrav signal and LIGO-Virgo Primordial Black Holes from the Higgs field

abstract: We show that the NANOGrav signal can come from the Higgs field with a noncanonical kinetic term in terms of the scalar induced gravitational waves. The scalar induced gravitational waves generated in our model are also detectable by space-based gravitational wave observatories. Primordial black holes with stellar masses that can explain LIGO-Virgo events are also produced. Therefore, the NANOGrav signal and the BHs in LIGO-Virgo events may both originate from the Higgs field.


title: TOI-220 $b$: a warm sub-Neptune discovered by TESS

abstract: In this paper we report the discovery of TOI-220 $b$, a new sub-Neptune detected by the Transiting Exoplanet Survey Satellite (TESS) and confirmed by radial velocity follow-up observations with the HARPS spectrograph. Based on the combined analysis of TESS transit photometry and high precision radial velocity measurements we estimate a planetary mass of 13.8 $\pm$ 1.0 M$_{Earth}$ and radius of 3.03 $\pm$ 0.15 R$_{Earth}$, implying a bulk density of 2.73 $\pm$ 0.47 $\textrm{g cm}^{-3}$. TOI-220 $b$ orbits a relative bright (V=10.4) and old (10.1$\pm$1.4 Gyr) K dwarf star with a period of $\sim$10.69 d. Thus, TOI-220 $b$ is a new warm sub-Neptune with very precise mass and radius determinations. A Bayesian analysis of the TOI-220 $b$ internal structure indicates that due to the strong irradiation it receives, the low density of this planet could be explained with a steam atmosphere in radiative-convective equilibrium and a supercritical water layer on top of a differentiated interior made of a silicate mantle and a small iron core.


title: TESS and HARPS reveal two sub-Neptunes around TOI 1062

abstract: The Transiting Exoplanet Survey Satellite (\textit{TESS}) mission was designed to perform an all-sky search of planets around bright and nearby stars. Here we report the discovery of two sub-Neptunes orbiting around the TOI 1062 (TIC 299799658), a V=10.25 G9V star observed in the TESS Sectors 1, 13, 27 & 28. We use precise radial velocity observations from HARPS to confirm and characterize these two planets. TOI 1062b has a radius of 2.265^{+0.095}_{-0.091} Re, a mass of 11.8 +\- 1.4 Me, and an orbital period of 4.115050 +/- 0.000007 days. The second planet is not transiting, has a minimum mass of 7.4 +/- 1.6 Me and is near the 2:1 mean motion resonance with the innermost planet with an orbital period of 8.13^{+0.02}_{-0.01} days. We performed a dynamical analysis to explore the proximity of the system to this resonance, and to attempt at further constraining the orbital parameters. The transiting planet has a mean density of 5.58^{+1.00}_{-0.89} g cm^-3 and an analysis of its internal structure reveals that it is expected to have a small volatile envelope accounting for 0.35% of the mass at maximum. The star's brightness and the proximity of the inner planet to the "radius gap" make it an interesting candidate for transmission spectroscopy, which could further constrain the composition and internal structure of TOI 1062b.


title: Continual Learning on the Edge with TensorFlow Lite

abstract: Deploying sophisticated deep learning models on embedded devices with the purpose of solving real-world problems is a struggle using today's technology. Privacy and data limitations, network connection issues, and the need for fast model adaptation are some of the challenges that constitute today's approaches unfit for many applications on the edge and make real-time on-device training a necessity. Google is currently working on tackling these challenges by embedding an experimental transfer learning API to their TensorFlow Lite, machine learning library. In this paper, we show that although transfer learning is a good first step for on-device model training, it suffers from catastrophic forgetting when faced with more realistic scenarios. We present this issue by testing a simple transfer learning model on the CORe50 benchmark as well as by demonstrating its limitations directly on an Android application we developed. In addition, we expand the TensorFlow Lite library to include continual learning capabilities, by integrating a simple replay approach into the head of the current transfer learning model. We test our continual learning model on the CORe50 benchmark to show that it tackles catastrophic forgetting, and we demonstrate its ability to continually learn, even under non-ideal conditions, using the application we developed. Finally, we open-source the code of our Android application to enable developers to integrate continual learning to their own smartphone applications, as well as to facilitate further development of continual learning functionality into the TensorFlow Lite environment.


title: \'Etale Covers and Fundamental Groups of Schematic Finite Spaces

abstract: We introduce the category of finite \'etale covers of an arbitrary schematic finite space $X$ and show that, equipped with an appropriate natural fiber functor, it is a Galois Category. This allows us to define the \'etale fundamental group of schematic spaces. If $X$ is a finite model of a scheme $S$, we show that the resulting Galois theory on $X$ coincides with the classical theory of finite \'etale covers on $S$ and therefore we recover the classical \'etale fundamental group introduced by Grothendieck. In order to prove these results it is crucial to find a suitable geometric notion of connectedness for schematic finite spaces and also to study their geometric points. We achieve these goals by means of the strong cohomological constraints enjoyed by schematic finite spaces.