title: Quantum billiards with correlated electrons confined in triangular transition metal dichalcogenide monolayer nanostructures created by laser quench

abstract: Forcing systems though fast non-equilibrium phase transitions offers the opportunity to study new states of quantum matter that self-assemble in their wake. Here we study the quantum interference effects of correlated electrons confined in monolayer quantum nanostructures, created by femtosecond laser-induced quench through a first-order polytype structural transition in a layered transition-metal dichalcogenide material. Scanning tunnelling microscopy of the electrons confined within equilateral triangles, whose dimensions are a few crystal unit cells on the side, reveals that the trajectories are strongly modified from free-electron states both by electronic correlations and confinement. Comparison of experiments with theoretical predictions of strongly correlated electron behaviour reveals that the confining geometry destabilizes the Wigner/Mott crystal ground state, resulting in mixed itinerant and correlation-localized states intertwined on a length scale of 1 nm. Occasionally, itinerant-electron states appear to follow quantum interferences which are suggestive of classical trajectories (quantum scars). The work opens the path toward understanding the quantum transport of electrons confined in atomic-scale monolayer structures based on correlated-electron-materials.


title: A Non-Intrusive Machine Learning Solution for Malware Detection and Data Theft Classification in Smartphones

abstract: Smartphones contain information that is more sensitive and personal than those found on computers and laptops. With an increase in the versatility of smartphone functionality, more data has become vulnerable and exposed to attackers. Successful mobile malware attacks could steal a user's location, photos, or even banking information. Due to a lack of post-attack strategies firms also risk going out of business due to data theft. Thus, there is a need besides just detecting malware intrusion in smartphones but to also identify the data that has been stolen to assess, aid in recovery and prevent future attacks. In this paper, we propose an accessible, non-intrusive machine learning solution to not only detect malware intrusion but also identify the type of data stolen for any app under supervision. We do this with Android usage data obtained by utilising publicly available data collection framework- SherLock. We test the performance of our architecture for multiple users on real-world data collected using the same framework. Our architecture exhibits less than 9% inaccuracy in detecting malware and can classify with 83% certainty on the type of data that is being stolen.


title: Cosmological solutions from 4D $N=4$ matter-coupled supergravity

abstract: From four-dimensional $N=4$ matter-coupled gauged supergravity, we study smooth time-dependent cosmological solutions interpolating between a $dS_2\times \Sigma_2$ spacetime, with $\Sigma_2 = S^2$ and $H^2$, in the infinite past and a $dS_4$ spacetime in the infinite future. The solutions were obtained by solving the second-order equations of motion from all the ten gauged theories known to admit $dS_4$ solutions, of which there are two types. Type I $dS$ gauged theories can admit both $dS$ solutions as well as supersymmetric $AdS$ solutions while type II $dS$ gauged theories only admit $dS$ solutions. We also study the extent to which the first-order equations that solve the aforementioned second-order field equations fail to admit the $dS_4$ vacua and their associated cosmological solutions.


title: Complete Bidirectional Typing for the Calculus of Inductive Constructions

abstract: This article presents a bidirectional type system for the Calculus of Inductive Constructions (CIC). It introduces a new judgement intermediate between the usual inference and checking, dubbed constrained inference, to handle the presence of computation in types. The key property of the system is its completeness with respect to the usual undirected one, which has been formally proven in Coq as a part of the MetaCoq project. Although it plays an important role in an ongoing completeness proof for a realistic typing algorithm, the interest of bidirectionality is wider, as it gives insights and structure when trying to prove properties on CIC or design variations and extensions. In particular, we put forward constrained inference, an intermediate between the usual inference and checking judgements, to handle the presence of computation in types.


title: Large-Scale Representation Learning on Graphs via Bootstrapping

abstract: Self-supervised learning provides a promising path towards eliminating the need for costly label information in representation learning on graphs. However, to achieve state-of-the-art performance, methods often need large numbers of negative examples and rely on complex augmentations. This can be prohibitively expensive, especially for large graphs. To address these challenges, we introduce Bootstrapped Graph Latents (BGRL) - a graph representation learning method that learns by predicting alternative augmentations of the input. BGRL uses only simple augmentations and alleviates the need for contrasting with negative examples, and is thus scalable by design. BGRL outperforms or matches prior methods on several established benchmarks, while achieving a 2-10x reduction in memory costs. Furthermore, we show that BGRL can be scaled up to extremely large graphs with hundreds of millions of nodes in the semi-supervised regime - achieving state-of-the-art performance and improving over supervised baselines where representations are shaped only through label information. In particular, our solution centered on BGRL constituted one of the winning entries to the Open Graph Benchmark - Large Scale Challenge at KDD Cup 2021, on a graph orders of magnitudes larger than all previously available benchmarks, thus demonstrating the scalability and effectiveness of our approach.


title: Mediastinal lymph nodes segmentation using 3D convolutional neural network ensembles and anatomical priors guiding

abstract: As lung cancer evolves, the presence of enlarged and potentially malignant lymph nodes must be assessed to properly estimate disease progression and select the best treatment strategy. Following the clinical guidelines, estimation of short-axis diameter and mediastinum station are paramount for correct diagnosis. A method for accurate and automatic segmentation is hence decisive for quantitatively describing lymph nodes. In this study, the use of 3D convolutional neural networks, either through slab-wise schemes or the leveraging of downsampled entire volumes, is investigated. Furthermore, the potential impact from simple ensemble strategies is considered. As lymph nodes have similar attenuation values to nearby anatomical structures, we suggest using the knowledge of other organs as prior information to guide the segmentation task. To assess the segmentation and instance detection performances, a 5-fold cross-validation strategy was followed over a dataset of 120 contrast-enhanced CT volumes. For the 1178 lymph nodes with a short-axis diameter $\geq10$ mm, our best performing approach reached a patient-wise recall of 92%, a false positive per patient ratio of 5, and a segmentation overlap of 80.5%. The method performs similarly well across all stations. Fusing a slab-wise and a full volume approach within an ensemble scheme generated the best performances. The anatomical priors guiding strategy is promising, yet a larger set than four organs appears needed to generate an optimal benefit. A larger dataset is also mandatory, given the wide range of expressions a lymph node can exhibit (i.e., shape, location, and attenuation), and contrast uptake variations.


title: How do climate change skeptics engage with opposing views? Understanding mechanisms of social identity and cognitive dissonance in an online forum

abstract: Does engagement with opposing views help break down ideological `echo chambers'; or does it backfire and reinforce them? This question remains critical as academics, policymakers and activists grapple with the question of how to regulate political discussion on social media. In this study, we contribute to the debate by examining the impact of opposing views within a major climate change skeptic online community on Reddit. A large sample of posts (N = 3000) was manually coded as either dissonant or consonant which allowed the automated classification of the full dataset of more than 50,000 posts, with codes inferred from linked websites. We find that ideologically dissonant submissions act as a stimulant to activity in the community: they received more attention (comments) than consonant submissions, even though they received lower scores through up-voting and down-voting. Users who engaged with dissonant submissions were also more likely to return to the forum. Consistent with identity theory, confrontation with opposing views triggered activity in the forum, particularly among users that are highly engaged with the community. In light of the findings, theory of social identity and echo chambers is discussed and enhanced.


title: Hawking-Radiation Recoil of Microscopic Black Holes

abstract: Hawking radiation would make microscopic black holes evaporate rapidly, which excludes them from many astrophysical considerations. However, it has been argued that the quantum nature of space would alter this behaviour: the temperature of a Planck-size black hole vanishes, and what is left behind is a Planck-mass remnant with the cross-section of $\approx 10^{-70}\mbox{m}^2$, which makes a direct observation nearly impossible. Such black hole remnants have been identified as possible dark matter candidates. Here, we argue that the final stage of evaporation has a recoil effect that gives them a velocity up to $\approx 10^{-1} c$. This would lead to a disagreement with the cold dark matter cosmological model unless the primordial black hole formation ceased shortly after the inflation era.


title: VitrAI -- Applying Explainable AI in the Real World

abstract: With recent progress in the field of Explainable Artificial Intelligence (XAI) and increasing use in practice, the need for an evaluation of different XAI methods and their explanation quality in practical usage scenarios arises. For this purpose, we present VitrAI, which is a web-based service with the goal of uniformly demonstrating four different XAI algorithms in the context of three real life scenarios and evaluating their performance and comprehensibility for humans. This work reveals practical obstacles when adopting XAI methods and gives qualitative estimates on how well different approaches perform in said scenarios.


title: Relations on continuities and boundedness in intuitionistic fuzzy pseudo normed linear spaces

abstract: In this study different types of intuitionistic fuzzy continuities (IFCs) and intuitionistic fuzzy boundedness (IFBs) in intuitionistic fuzzy pseudo normed linear spaces are studied. Relations (intra and inter) on intuitionistic fuzzy continuities and intuitionistic fuzzy boundedness are investigated.


title: Convex Synthesis of Accelerated Gradient Algorithms

abstract: We present a convex solution for the design of generalized accelerated gradient algorithms for strongly convex objective functions with Lipschitz continuous gradients. We utilize integral quadratic constraints and the Youla parameterization from robust control theory to formulate a solution of the algorithm design problem as a convex semi-definite program. We establish explicit formulas for the optimal convergence rates and extend the proposed synthesis solution to extremum control problems.


title: Robust and integrative Bayesian neural networks for likelihood-free parameter inference

abstract: State-of-the-art neural network-based methods for learning summary statistics have delivered promising results for simulation-based likelihood-free parameter inference. Existing approaches require density estimation as a post-processing step building upon deterministic neural networks, and do not take network prediction uncertainty into account. This work proposes a robust integrated approach that learns summary statistics using Bayesian neural networks, and directly estimates the posterior density using categorical distributions. An adaptive sampling scheme selects simulation locations to efficiently and iteratively refine the predictive posterior of the network conditioned on observations. This allows for more efficient and robust convergence on comparatively large prior spaces. We demonstrate our approach on benchmark examples and compare against related methods.


title: Sequential Neural Posterior and Likelihood Approximation

abstract: We introduce the sequential neural posterior and likelihood approximation (SNPLA) algorithm. SNPLA is a normalizing flows-based algorithm for inference in implicit models, and therefore is a simulation-based inference method that only requires simulations from a generative model. SNPLA avoids Markov chain Monte Carlo sampling and correction-steps of the parameter proposal function that are introduced in similar methods, but that can be numerically unstable or restrictive. By utilizing the reverse KL divergence, SNPLA manages to learn both the likelihood and the posterior in a sequential manner. Over four experiments, we show that SNPLA performs competitively when utilizing the same number of model simulations as used in other methods, even though the inference problem for SNPLA is more complex due to the joint learning of posterior and likelihood function. Due to utilizing normalizing flows SNPLA generates posterior draws much faster (4 orders of magnitude) than MCMC-based methods.


title: A survey of exoplanet phase curves with Ariel

abstract: The ESA-Ariel mission will include a tier dedicated to exoplanet phase curves corresponding to ~10% of the science time. We present here the current observing strategy for studying exoplanet phase curves with Ariel. We define science questions, requirements and a list of potential targets. We also estimate the precision of phase curve reconstruction and atmospheric retrieval using simulated phase curves. Based on this work, we found that full-orbit phase variations for 35-40 exoplanets could be observed during the 3.5-yr mission. This statistical sample would provide key constraints on atmospheric dynamics, composition, thermal structure and clouds of warm exoplanets, complementary to the scientific yield from spectroscopic transits/eclipses measurements.


title: The Foundation Supernova Survey: Photospheric Velocity Correlations in Type Ia Supernovae

abstract: The ejecta velocities of type-Ia supernovae (SNe Ia), as measured by the Si II $\lambda 6355$ line, have been shown to correlate with other supernova properties, including color and standardized luminosity. We investigate these results using the Foundation Supernova Survey, with a spectroscopic data release presented here, and photometry analyzed with the SALT2 light-curve fitter. We find that the Foundation data do not show significant evidence for an offset in color between SNe Ia with high and normal photospheric velocities, with $\Delta c = 0.005 \pm 0.014$. Our SALT2 analysis does show evidence for redder high-velocity SN Ia in other samples, including objects from the Carnegie Supernova Project, with a combined sample yielding $\Delta c = 0.017 \pm 0.007$. When split on velocity, the Foundation SN Ia also do not show a significant difference in Hubble diagram residual, $\Delta HR = 0.015 \pm 0.049$ mag. Intriguingly, we find that SN Ia ejecta velocity information may be gleaned from photometry, particularly in redder optical bands. For high-redshift SN Ia, these rest-frame red wavelengths will be observed by the Nancy Grace Roman Space Telescope. Our results also confirm previous work that SN Ia host-galaxy stellar mass is strongly correlated with ejecta velocity: high-velocity SN Ia are found nearly exclusively in high-stellar-mass hosts. However, host-galaxy properties alone do not explain velocity-dependent differences in supernova colors and luminosities across samples. Measuring and understanding the connection between intrinsic explosion properties and supernova environments, across cosmic time, will be important for precision cosmology with SNe Ia.

categories: astro-ph.HE astro-ph.CO astro-ph.GA astro-ph.SR


title: Leveraging Reinforcement Learning for evaluating Robustness of KNN Search Algorithms

abstract: The problem of finding K-nearest neighbors in the given dataset for a given query point has been worked upon since several years. In very high dimensional spaces the K-nearest neighbor search (KNNS) suffers in terms of complexity in computation of high dimensional distances. With the issue of curse of dimensionality, it gets quite tedious to reliably bank on the results of variety approximate nearest neighbor search approaches. In this paper, we survey some novel K-Nearest Neighbor Search approaches that tackles the problem of Search from the perspectives of computations, the accuracy of approximated results and leveraging parallelism to speed-up computations. We attempt to derive a relationship between the true positive and false points for a given KNNS approach. Finally, in order to evaluate the robustness of a KNNS approach against adversarial points, we propose a generic Reinforcement Learning based framework for the same.


title: Comparison of Machine Learning Classifiers to Predict Patient Survival and Genetics of GBM: Towards a Standardized Model for Clinical Implementation

abstract: Radiomic models have been shown to outperform clinical data for outcome prediction in glioblastoma (GBM). However, clinical implementation is limited by lack of parameters standardization. We aimed to compare nine machine learning classifiers, with different optimization parameters, to predict overall survival (OS), isocitrate dehydrogenase (IDH) mutation, O-6-methylguanine-DNA-methyltransferase (MGMT) promoter methylation, epidermal growth factor receptor (EGFR) VII amplification and Ki-67 expression in GBM patients, based on radiomic features from conventional and advanced MR. 156 adult patients with pathologic diagnosis of GBM were included. Three tumoral regions were analyzed: contrast-enhancing tumor, necrosis and non-enhancing tumor, selected by manual segmentation. Radiomic features were extracted with a custom version of Pyradiomics, and selected through Boruta algorithm. A Grid Search algorithm was applied when computing 4 times K-fold cross validation (K=10) to get the highest mean and lowest spread of accuracy. Once optimal parameters were identified, model performances were assessed in terms of Area Under The Curve-Receiver Operating Characteristics (AUC-ROC). Metaheuristic and ensemble classifiers showed the best performance across tasks. xGB obtained maximum accuracy for OS (74.5%), AB for IDH mutation (88%), MGMT methylation (71,7%), Ki-67 expression (86,6%), and EGFR amplification (81,6%). Best performing features shed light on possible correlations between MR and tumor histology.


title: Mutually exciting point process graphs for modelling dynamic networks

abstract: A new class of models for dynamic networks is proposed, called mutually exciting point process graphs (MEG). MEG is a scalable network-wide statistical model for point processes with dyadic marks, which can be used for anomaly detection when assessing the significance of future events, including previously unobserved connections between nodes. The model combines mutually exciting point processes to estimate dependencies between events and latent space models to infer relationships between the nodes. The intensity functions for each network edge are characterised exclusively by node-specific parameters, which allows information to be shared across the network. This construction enables estimation of intensities even for unobserved edges, which is particularly important in real world applications, such as computer networks arising in cyber-security. A recursive form of the log-likelihood function for MEG is obtained, which is used to derive fast inferential procedures via modern gradient ascent algorithms. An alternative EM algorithm is also derived. The model and algorithms are tested on simulated graphs and real world datasets, demonstrating excellent performance.


title: A Tale of Two Countries: A Longitudinal Cross-Country Study of Mobile Users' Reactions to the COVID-19 Pandemic Through the Lens of App Popularity

abstract: The ongoing COVID-19 pandemic has profoundly impacted people's life around the world, including how they interact with mobile technologies. In this paper, we seek to develop an understanding of how the dynamic trajectory of a pandemic shapes mobile phone users' experiences. Through the lens of app popularity, we approach this goal from a cross-country perspective. We compile a dataset consisting of six-month daily snapshots of the most popular apps in the iOS App Store in China and the US, where the pandemic has exhibited distinct trajectories. Using this longitudinal dataset, our analysis provides detailed patterns of app ranking during the pandemic at both category and individual app levels. We reveal that app categories' rankings are correlated with the pandemic, contingent upon country-specific development trajectories. Our work offers rich insights into how the COVID-19, a typical global public health crisis, has influence people's day-to-day interaction with the Internet and mobile technologies.


title: Improving Object Detection in Art Images Using Only Style Transfer

abstract: Despite recent advances in object detection using deep learning neural networks, these neural networks still struggle to identify objects in art images such as paintings and drawings. This challenge is known as the cross depiction problem and it stems in part from the tendency of neural networks to prioritize identification of an object's texture over its shape. In this paper we propose and evaluate a process for training neural networks to localize objects - specifically people - in art images. We generate a large dataset for training and validation by modifying the images in the COCO dataset using AdaIn style transfer. This dataset is used to fine-tune a Faster R-CNN object detection network, which is then tested on the existing People-Art testing dataset. The result is a significant improvement on the state of the art and a new way forward for creating datasets to train neural networks to process art images.


title: A flexible anatomical set of mechanical models for the organ of Corti

abstract: We built a flexible platform to study the mechanical operation of the organ of Corti (OoC) in the transduction of basilar membrane (BM) vibrations to oscillations of an inner hair cell bundle (IHB). The anatomical components that we consider are the outer hair cells (OHCs), the outer hair cell bundles, Deiters cells, Hensen cells, the IHB and various sections of the reticular lamina. In each of the components we apply Newton's equations of motion. The components are coupled to each other and are further coupled to the endolymph fluid motion in the subtectorial gap. This allows us to obtain the forces acting on the IHB, and thus study its motion as a function of the parameters of the different components. Some of the components include a nonlinear mechanical response. We found that slight bending of the apical ends of the OHCs can have a significant impact on the passage of motion from the BM to the IHB, including critical oscillator behaviour. In particular, our model implies that the components of the OoC could cooperate to enhance frequency selectivity, amplitude compression and signal to noise ratio in the passage from the BM to the IHB. Since the model is modular, it is easy to modify the assumptions and parameters for each component.


title: Editorial: Introduction to the Issue on Deep Learning for Image/Video Restoration and Compression

abstract: Recent works have shown that learned models can achieve significant performance gains, especially in terms of perceptual quality measures, over traditional methods. Hence, the state of the art in image restoration and compression is getting redefined. This special issue covers the state of the art in learned image/video restoration and compression to promote further progress in innovative architectures and training methods for effective and efficient networks for image/video restoration and compression.


title: Algebraic cocompleteness and finitary functors

abstract: A number of categories is presented that are algebraically complete and cocomplete, i.e., every endofunctor has an initial algebra and a terminal coalgebra. For all finitary (and, more generally, all precontinuous) set functors the initial algebra and terminal coalgebra are proved to carry a canonical partial order with the same ideal CPO-completion. And they also both carry a canonical ultrametric with the same Cauchy completion.


title: Exciton transport in amorphous polymers and the role of morphology and thermalisation

abstract: Understanding the transport mechanism of electronic excitations in conjugated polymers is key to advancing organic optoelectronic applications, such as solar cells, OLEDs and flexible electronics. While crystalline polymers can be studied using solid-state techniques based on lattice periodicity, the characterisation of amorphous polymers is hindered by an intermediate regime of disorder and the associated lack of symmetries. To overcome these hurdles we use a reduced state quantum master equation approach based on the Merrifield exciton formalism. Using this model we study exciton transport in conjugated polymers and its dependence on morphology and temperature. Exciton dynamics consists of a thermalisation process, whose features depend on the relative strength of thermal energy, electronic couplings and disorder, resulting in remarkably different transport regimes. By applying this method to representative systems based on poly(p-phenylene vinylene) (PPV) we obtain insight into the role of temperature and disorder on localisation, charge separation, non-equilibrium dynamics, and experimental accessibility of thermal equilibrium states of excitons in amorphous polymers.


title: DandeLiion v1: An extremely fast solver for the Newman model of lithium-ion battery (dis)charge

abstract: DandeLiion (available at dandeliion.com) is a robust and extremely fast solver for the Doyle Fuller Newman (DFN) model, the standard electrochemical model for (dis)charge of a planar lithium-ion cell. DandeLiion conserves lithium, uses a second order spatial discretisation method (enabling accurate computations using relatively coarse discretisations) and is many times faster than its competitors. The code can be used `in the cloud' and does not require installation before use. The difference in compute time between DandeLiion and its commercial counterparts is roughly a factor of 100 for the moderately-sized test case of the discharge of a single cell. Its linear scaling property means that the disparity in performance is even more pronounced for bigger systems, making it particularly suitable for applications involving multiple coupled cells. The model is characterised by a number of phenomenological parameters and functions, which may either be provided by the user or chosen from DandeLiion's library. This library contains data for the most commonly used electrolyte (LiPF6) and a number of common active material chemistries including graphite, lithium iron phosphate (LFP), nickel cobalt aluminium (NCA), and a variant of nickel cobalt manganese (NMC).


title: Hybrid quantum convolutional neural networks model for COVID-19 prediction using chest X-Ray images

abstract: Despite the great efforts to find an effective way for COVID-19 prediction, the virus nature and mutation represent a critical challenge to diagnose the covered cases. However, developing a model to predict COVID-19 via Chest X-Ray (CXR) images with accurate performance is necessary to help in early diagnosis. In this paper, a hybrid quantum-classical convolutional Neural Networks (HQCNN) model used the random quantum circuits (RQCs) as a base to detect COVID-19 patients with CXR images. A collection of 6952 CXR images, including 1161 COVID-19, 1575 normal, and 5216 pneumonia images, were used as a dataset in this work. The proposed HQCNN model achieved higher performance with an accuracy of 98.4\% and a sensitivity of 99.3\% on the first dataset cases. Besides, it obtained an accuracy of 99\% and a sensitivity of 99.7\% on the second dataset cases. Also, it achieved accuracy, and sensitivity of 88.6\%, and 88.7\%, respectively, on the third multi-class dataset cases. Furthermore, the HQCNN model outperforms various models in balanced accuracy, precision, F1-measure, and AUC-ROC score. The experimental results are achieved by the proposed model prove its ability in predicting positive COVID-19 cases.


title: CrossStack: A 3-D Reconfigurable RRAM Crossbar Inference Engine

abstract: Deep neural network inference accelerators are rapidly growing in importance as we turn to massively parallelized processing beyond GPUs and ASICs. The dominant operation in feedforward inference is the multiply-and-accumlate process, where each column in a crossbar generates the current response of a single neuron. As a result, memristor crossbar arrays parallelize inference and image processing tasks very efficiently. In this brief, we present a 3-D active memristor crossbar array `CrossStack', which adopts stacked pairs of Al/TiO2/TiO2-x/Al devices with common middle electrodes. By designing CMOS-memristor hybrid cells used in the layout of the array, CrossStack can operate in one of two user-configurable modes as a reconfigurable inference engine: 1) expansion mode and 2) deep-net mode. In expansion mode, the resolution of the network is doubled by increasing the number of inputs for a given chip area, reducing IR drop by 22%. In deep-net mode, inference speed per-10-bit convolution is improved by 29\% by simultaneously using one TiO2/TiO2-x layer for read processes, and the other for write processes. We experimentally verify both modes on our $10\times10\times2$ array.


title: Bistability of the BiOi complex and its implications on evaluating the acceptor removal

abstract: The dependencies of the B$_{i}$O$_{i}$ defect concentration on doping, irradiation fluence and particle type in p-type silicon diodes have been investigated. We evidenced that large data scattering occurs for fluences above $10^{12}$ 1 MeV neutrons/cm$^2$, becoming significant larger for higher fluences. We show that the B$_{i}$O$_{i}$ defect is metastable, with two configurations A and B, of which only A is detected by Deep Level Transient Spectroscopy and Thermally Stimulated Currents techniques. The defect's electrical activity is influenced by the inherent variations in ambient and procedural experimental conditions, resulting not only in a large scattering of the results coming from the same type of measurement but making any correlation between different types of experiments difficult. It is evidenced that the variations in [B$_{i}$O$_{i}^\mathrm{A}$] are triggered by subjecting the samples to an excess of carriers, by either heating or an inherent short exposure to ambient light when manipulating the samples prior to experiments. It causes $\approx$7h variations in both, the [B$_{i}$O$_{i}^\mathrm{A}$] and in the effective space charge. The analyses of structural damage in a diode irradiated with 10$^{19}$ 1 MeV neutrons/cm$^2$ revealed that the Si structure remains crystalline and vacancies and interstitials organize in parallel tracks normal to the Si-SiO$_{2}$ interface.


title: Lazy Hermite Reduction and Creative Telescoping for Algebraic Functions

abstract: Bronstein's lazy Hermite reduction is a symbolic integration technique that reduces algebraic functions to integrands with only simple poles without the prior computation of an integral basis. We sharpen the lazy Hermite reduction by combining it with the polynomial reduction to solve the decomposition problem of algebraic functions. The sharpened reduction is then used to design a reduction-based telescoping algorithm for algebraic functions in two variables.


title: Jacobian Determinant of Normalizing Flows

abstract: Normalizing flows learn a diffeomorphic mapping between the target and base distribution, while the Jacobian determinant of that mapping forms another real-valued function. In this paper, we show that the Jacobian determinant mapping is unique for the given distributions, hence the likelihood objective of flows has a unique global optimum. In particular, the likelihood for a class of flows is explicitly expressed by the eigenvalues of the auto-correlation matrix of individual data point, and independent of the parameterization of neural network, which provides a theoretical optimal value of likelihood objective and relates to probabilistic PCA. Additionally, Jacobian determinant is a measure of local volume change and is maximized when MLE is used for optimization. To stabilize normalizing flows training, it is required to maintain a balance between the expansiveness and contraction of volume, meaning Lipschitz constraint on the diffeomorphic mapping and its inverse. With these theoretical results, several principles of designing normalizing flow were proposed. And numerical experiments on highdimensional datasets (such as CelebA-HQ 1024x1024) were conducted to show the improved stability of training.


title: Two Training Strategies for Improving Relation Extraction over Universal Graph

abstract: This paper explores how the Distantly Supervised Relation Extraction (DS-RE) can benefit from the use of a Universal Graph (UG), the combination of a Knowledge Graph (KG) and a large-scale text collection. A straightforward extension of a current state-of-the-art neural model for DS-RE with a UG may lead to degradation in performance. We first report that this degradation is associated with the difficulty in learning a UG and then propose two training strategies: (1) Path Type Adaptive Pretraining, which sequentially trains the model with different types of UG paths so as to prevent the reliance on a single type of UG path; and (2) Complexity Ranking Guided Attention mechanism, which restricts the attention span according to the complexity of a UG path so as to force the model to extract features not only from simple UG paths but also from complex ones. Experimental results on both biomedical and NYT10 datasets prove the robustness of our methods and achieve a new state-of-the-art result on the NYT10 dataset. The code and datasets used in this paper are available at https://github.com/baodaiqin/UGDSRE.


title: Upper functions for sample paths of L\'evy(-type) processes

abstract: We study the small-time asymptotics of sample paths of L\'evy processes and L\'evy-type processes. Namely, we investigate under which conditions the limit $$\limsup_{t \to 0} \frac{1}{f(t)} |X_t-X_0|$$ is finite resp.\ infinite with probability $1$. We establish integral criteria in terms of the infinitesimal characteristics and the symbol of the process. Our results apply to a wide class of processes, including solutions to L\'evy-driven SDEs and stable-like processes. For the particular case of L\'evy processes, we recover and extend earlier results from the literature. Moreover, we present a new maximal inequality for L\'evy-type processes, which is of independent interest.


title: Method for Calculating Excited Electronic States Using Density Functionals and Direct Orbital Optimization with Real Space Grid or Plane Wave Basis Set

abstract: A direct orbital optimization method is presented for density functional calculations of excited electronic states using either a real space grid or a plane wave basis set. The method is variational, provides atomic forces in the excited states, and can be applied to Kohn-Sham (KS) functionals as well as orbital-density dependent functionals (ODD) including explicit self-interaction correction. The implementation for KS functionals involves two nested loops: (1) An inner loop for finding a stationary point in a subspace spanned by the occupied and a few virtual orbitals corresponding to the excited state; (2) an outer loop for minimizing the energy in a tangential direction in the space of the orbitals. For ODD functionals, a third loop is used to find the unitary transformation that minimizes the energy functional among occupied orbitals only. Combined with the maximum overlap method, the algorithm converges in challenging cases where conventional self-consistent field algorithms tend to fail. The benchmark tests presented include two charge-transfer excitations in nitrobenzene and an excitation of CO to degenerate $\pi^\ast$ orbitals where the importance of complex orbitals is illustrated. An application of the method to several metal-to-ligand charge-transfer and metal-centred excited states of an Fe$^{\rm II}$ photosensitizer complex is described and the results compared to reported experimental estimates. The method is also used to study the effect of Perdew-Zunger self-interaction correction on valence and Rydberg excited states of several molecules, both singlet and triplet states, and the performance compared to semilocal and hybrid functionals.


title: Computing Betweenness Centrality in Link Streams

abstract: Betweeness centrality is one of the most important concepts in graph analysis. It was recently extended to link streams, a graph generalization where links arrive over time. However, its computation raises non-trivial issues, due in particular to the fact that time is considered as continuous. We provide here the first algorithms to compute this generalized betweenness centrality, as well as several companion algorithms that have their own interest. They work in polynomial time and space, we illustrate them on typical examples, and we provide an implementation.


title: The stellar content of H72.97-69.39, a potential super star cluster in the making

abstract: Young Massive Clusters (YMCs) and Super Star Clusters (SSCs) represent an extreme mode of star formation. Far-infrared imaging of the Magellanic Clouds has identified one potential embedded SSC, HSO BMHERICC J72.971176-69.391112 (HH in short), in the south-west outskirts of the Large Magellanic Cloud. We present Gemini Flamingos 2 and GSAOI near-infrared imaging of a 3'x3' region around HH in order to characterize the stellar content of the cluster. The stellar content is probed down to 1.5 Msun. We find substantial dust extinction across the cluster region, extending up to A_K of 3. Deeply embedded stars are associated with ALMA-detected molecular gas suggesting that star formation is ongoing. The high spatial resolution of the GSAOI data allows identification of the central massive object associated with the 13CO ALMA observations and to detect fainter low-mass stars around the H30alpha ALMA source. The morphology of the molecular gas and the nebulosity from adjacent star formation suggest they have interacted covering a region of several pc. The total stellar content in the cluster is estimated from the intermediate- and high-mass stellar content to be at least 10000 Msun, less than R136 with up to 100 000 Msun within 4.7 pc radius, but places it in the regime of a super star cluster. Based on the extinction determination of individual stars we estimate a molecular gas mass in the vicinity of HH of 6600 Msun, suggesting more star formation can be expected.


title: Site-Selective Dynamics of Azidolysozyme

abstract: The spectroscopic response of and structural dynamics around all azido-modified alanine residues (AlaN$_3$) in Lysozyme is characterized. It is found that AlaN$_3$ is a positionally sensitive probe for the local dynamics, covering a frequency range of $\sim 15$ cm$^{-1}$ for the center frequency of the line shape. This is consistent with findings from selective replacements of amino acids in PDZ2 which reported a frequency span of $\sim 10$ cm$^{-1}$ for replacements of Val, Ala, or Glu by azidohomoalanine (AHA). For the frequency fluctuation correlation functions (FFCFs) the long-time decay constants $\tau_2$ range from $\sim 1$ to $\sim 10$ ps which compares with experimentally measured correlation times of 3 ps. Attaching azide to alanine residues can yield dynamics that decays to zero on the few ps time scale (i.e. static component $\Delta_0 \sim 0$ ps$^{-1}$) or to a remaining, static contribution of $\sim 0.5$ ps$^{-1}$ (corresponding to 2.5 cm$^{-1}$), depending on the local environment on the 10 ps time scale. The magnitude of the static component correlates qualitatively with the degree of hydration of the spectroscopic probe. Although attaching azide to alanine residues is found to be structurally minimally invasive with respect to the overall protein structure, analysis of the local hydrophobicity indicates that the hydration around the modification site differs for modified and unmodified alanine residues, respectively.


title: Tunable critical correlations in kagome ice

abstract: We present a comprehensive experimental and theoretical study of the kagome ice Coulomb phase, that explores the fine tuning of critical correlations by applied field, temperature and crystal orientation. The continuous modification of algebraic correlations is observed by polarised neutron scattering experiments and is found to be well described by numerical simulations of an idealised model. We further clarify the thermodynamics of field tuned Kasteleyn transitions and demonstrate some dramatic finite size scaling properties that depend on how topological string defects wind around the system boundaries. We conclude that kagome ice is a remarkable example of a critical and topological state in a real system that may be subject to fine experimental control.


title: Like Attract Like? A Structural Comparison of Homogamy across Same-Sex and Different-Sex Households

abstract: In this paper, we extend Gary Becker's empirical analysis of the marriage market to same-sex couples. Becker's theory rationalizes the well-known phenomenon of homogamy among different-sex couples: individuals mate with their likes because many characteristics, such as education, consumption behaviour, desire to nurture children, religion, etc., exhibit strong complementarities in the household production function. However, because of asymmetries in the distributions of male and female characteristics, men and women may need to marry "up" or "down" according to the relative shortage of their characteristics among the populations of men and women. Yet, among same-sex couples, this limitation does not exist as partners are drawn from the same population, and thus the theory of assortative mating would boldly predict that individuals will choose a partner with nearly identical characteristics. Empirical evidence suggests a very different picture: a robust stylized fact is that the correlation of the characteristics is in fact weaker among same-sex couples. In this paper, we build an equilibrium model of same-sex marriage market which allows for straightforward identification of the gains to marriage. We estimate the model with 2008-2012 ACS data on California and show that positive assortative mating is weaker for homosexuals than for heterosexuals with respect to age and race. Our results suggest that positive assortative mating with respect to education is stronger among lesbians, and not significantly different when comparing gay men and married different-sex couples. As regards labor market outcomes, such as hourly wages and working hours, we find some indications that the process of specialization within the household mainly applies to different-sex couples.


title: Is Q-Learning Minimax Optimal? A Tight Sample Complexity Analysis

abstract: Q-learning, which seeks to learn the optimal Q-function of a Markov decision process (MDP) in a model-free fashion, lies at the heart of reinforcement learning. When it comes to the synchronous setting (such that independent samples for all state-action pairs are drawn from a generative model in each iteration), substantial progress has been made towards understanding the sample efficiency of Q-learning. Consider a $\gamma$-discounted infinite-horizon MDP with state space $\mathcal{S}$ and action space $\mathcal{A}$: to yield an entrywise $\varepsilon$-approximation of the optimal Q-function, state-of-the-art theory for Q-learning requires a sample size exceeding the order of $\frac{|\mathcal{S}||\mathcal{A}|}{(1-\gamma)^5\varepsilon^{2}}$, which fails to match existing minimax lower bounds. This gives rise to natural questions: what is the sharp sample complexity of Q-learning? Is Q-learning provably sub-optimal? This paper addresses these questions for the synchronous setting: (1) when $|\mathcal{A}|=1$ (so that Q-learning reduces to TD learning), we prove that the sample complexity of TD learning is minimax optimal and scales as $\frac{|\mathcal{S}|}{(1-\gamma)^3\varepsilon^2}$ (up to log factor); (2) when $|\mathcal{A}|\geq 2$, we settle the sample complexity of Q-learning to be on the order of $\frac{|\mathcal{S}||\mathcal{A}|}{(1-\gamma)^4\varepsilon^2}$ (up to log factor). Our theory unveils the strict sub-optimality of Q-learning when $|\mathcal{A}|\geq 2$, and rigorizes the negative impact of over-estimation in Q-learning. Finally, we extend our analysis to accommodate asynchronous Q-learning (i.e., the case with Markovian samples), sharpening the horizon dependency of its sample complexity to be $\frac{1}{(1-\gamma)^4}$.

categories: stat.ML cs.IT cs.LG math.IT math.OC math.ST stat.TH


title: On a simple model for describing convection of the rotating fluid: integrability, bifurcations and global dynamics

abstract: The Glukhovsky-Dolzhansky (GD) model arises naturally from geophysical science, which describes rotating fluid convection inside the ellipsoid. This work aims to provide some new insights into the GD model. (\emph{i}) We first show that, under some conditions there are homothetic transformations which covert the GD model into other similar quadric physical models, therefore, our results on the GD model can be naturally applied to the investigation of these models. (\emph{ii}) We propose a complete classification of Darboux polynomials and exponent factors for the GD model, which implies that the GD model has no polynomial, rational, or Darboux first integrals. In addition, some integrable cases of the GD model are also given when the physical parameters are allowed to be non-positive. (\emph{iii}) The existence of global attractor is proved. The stability and local bifurcations of all co-dimension one and two are investigated. Particularly, we show that the GD model undergoes two dynamical transitions as the Rayleigh number increases. (\emph{iv}) To understand the asymptotic behavior of the orbits for the GD model, we use the Poincar\'{e} compactification method to study its dynamical behavior at infinity. More precisely, we prove that the phase portraits of the GD model at infinity consist of an infinite sequence of periodic solutions and two heteroclinic loops. Our results may help us better understand the complex and rich dynamics of rotating fluid convection.


title: Barrow Entropy Corrections to Friedmann Equations

abstract: Inspired by the Covid-$19$ virus structure, Barrow argued that quantum-gravitational effects may introduce intricate, fractal features on the black hole horizon [Phys. Lett. B {\bf808} (2020) 135643]. In this viewpoint, black hole entropy no longer obeys the area law and instead it can be given by $S\sim A^{1+\delta/2}$, where the exponent $\delta$ ranges $0\leq\delta\leq1$, and indicates the amount of the quantum-gravitational deformation effects. Based on this, and using the deep connection between gravity and thermodynamics, we disclose the effects of the Barrow entropy on the cosmological equations. For this purpose, we start from the first law of thermodynamics, $dE=TdS+WdV$, on the apparent horizon of the Friedmann-Robertson-Walker (FRW) Universe, and derive the corresponding modified Friedmann equations by assuming the entropy associated with the apparent horizon has the form of Barrow entropy. We also examine the validity of the generalized second law of thermodynamics for the Universe enclosed by the apparent horizon. Finally, we employ the emergence scenario of gravity and extract the modified Friedmann equation in the presence of Barrow entropy which coincide with one obtained from the first law of thermodynamics. When $\delta=0$, the results of standard cosmology are deduced.


title: A Little Pretraining Goes a Long Way: A Case Study on Dependency Parsing Task for Low-resource Morphologically Rich Languages

abstract: Neural dependency parsing has achieved remarkable performance for many domains and languages. The bottleneck of massive labeled data limits the effectiveness of these approaches for low resource languages. In this work, we focus on dependency parsing for morphological rich languages (MRLs) in a low-resource setting. Although morphological information is essential for the dependency parsing task, the morphological disambiguation and lack of powerful analyzers pose challenges to get this information for MRLs. To address these challenges, we propose simple auxiliary tasks for pretraining. We perform experiments on 10 MRLs in low-resource settings to measure the efficacy of our proposed pretraining method and observe an average absolute gain of 2 points (UAS) and 3.6 points (LAS). Code and data available at: https://github.com/jivnesh/LCM


title: The interplay of fast waves and slow convection in geodynamo simulations nearing Earth's core conditions

abstract: Ground observatory and satellite-based determinations of temporal variations in the geomagnetic field probe a decadal to annual time scale range where Earth's core slow, inertialess convective motions and rapidly propagating, inertia-bearing hydromagnetic waves are in interplay. Here we numerically model and jointly investigate these two important features with the help of a geodynamo simulation that (to date) is the closest to the dynamical regime of Earth's core. This model also considerably enlarges the scope of a previous asymptotic scaling analysis. Three classes of hydrodynamic and hydromagnetic waves are identified in the model output, all with propagation velocity largely exceeding that of convective advection: axisymmetric, geostrophic Alfv\'en torsional waves, and non-axisymmetric, quasi-geostrophic Alfv\'en and Rossby waves. The contribution of these waves to the geomagnetic acceleration amounts to an enrichment and flattening of its energy density spectral profile at decadal time scales, thereby providing a constraint on the extent of the $f^{-4}$ range observed in the geomagnetic frequency power spectrum. The flow and magnetic acceleration energies carried by waves both linearly increase with the ratio of the magnetic diffusion time scale to the Alfv\'en time scale, highlighting the dominance of Alfv\'en waves in the signal and the stabilising control of magnetic dissipation at non-axisymmetric scales. Extrapolation of the results to Earth's core conditions supports the detectability of Alfv\'en waves in geomagnetic observations, either as axisymmetric torsional oscillations or through the geomagnetic jerks caused by non-axisymmetric waves. In contrast, Rossby waves appear to be too fast and carry too little magnetic energy to be detectable in geomagnetic acceleration signals of limited spatio-temporal resolution.


title: From System Level Synthesis to Robust Closed-loop Data-enabled Predictive Control

abstract: Willems' fundamental lemma and system level synthesis both characterize a linear dynamic system by its input/output sequences. In this work, we extend the application of the fundamental lemma from deterministic to uncertain LTI systems and then further prove this extension to be equivalent to system level synthesis. Based on this uncertain extension, a robust closed-loop data-enabled predictive control scheme is proposed, where a causal feedback control law is further derived. Two numerical experiments, including the temperature control of a single-zone building, are carried out to validate the effectiveness of the proposed data-driven controller.


title: Exploiting Spline Models for the Training of Fully Connected Layers in Neural Network

abstract: The fully connected (FC) layer, one of the most fundamental modules in artificial neural networks (ANN), is often considered difficult and inefficient to train due to issues including the risk of overfitting caused by its large amount of parameters. Based on previous work studying ANN from linear spline perspectives, we propose a spline-based approach that eases the difficulty of training FC layers. Given some dataset, we first obtain a continuous piece-wise linear (CPWL) fit through spline methods such as multivariate adaptive regression spline (MARS). Next, we construct an ANN model from the linear spline model and continue to train the ANN model on the dataset using gradient descent optimization algorithms. Our experimental results and theoretical analysis show that our approach reduces the computational cost, accelerates the convergence of FC layers, and significantly increases the interpretability of the resulting model (FC layers) compared with standard ANN training with random parameter initialization followed by gradient descent optimizations.


title: Online Graph Dictionary Learning

abstract: Dictionary learning is a key tool for representation learning, that explains the data as linear combination of few basic elements. Yet, this analysis is not amenable in the context of graph learning, as graphs usually belong to different metric spaces. We fill this gap by proposing a new online Graph Dictionary Learning approach, which uses the Gromov Wasserstein divergence for the data fitting term. In our work, graphs are encoded through their nodes' pairwise relations and modeled as convex combination of graph atoms, i.e. dictionary elements, estimated thanks to an online stochastic algorithm, which operates on a dataset of unregistered graphs with potentially different number of nodes. Our approach naturally extends to labeled graphs, and is completed by a novel upper bound that can be used as a fast approximation of Gromov Wasserstein in the embedding space. We provide numerical evidences showing the interest of our approach for unsupervised embedding of graph datasets and for online graph subspace estimation and tracking.


title: Universal size-dependent nonlinear charge transport in single crystals of the Mott insulator Ca$_2$RuO$_4$

abstract: The surprisingly low current density required for inducing the insulator to metal transition has made Ca$_2$RuO$_4$ an attractive candidate material for developing Mott-based electronics devices. The mechanism driving the resistive switching, however, remains a controversial topic in the field of strongly correlated electron systems. Here we probe an uncovered region of phase space by studying high-purity Ca$_2$RuO$_4$ single crystals, using the sample size as principal tuning parameter. Upon reducing the crystal size, we find a four orders of magnitude increase in the current density required for driving Ca$_2$RuO$_4$ out of the insulating state into a non-equilibrium (also called metastable) phase which is the precursor to the fully metallic phase. By integrating a microscopic platinum thermometer and performing thermal simulations, we gain insight into the local temperature during simultaneous application of current and establish that the size dependence is not a result of Joule heating. The findings suggest an inhomogeneous current distribution in the nominally homogeneous crystal. Our study calls for a reexamination of the interplay between sample size, charge current, and temperature in driving Ca$_2$RuO$_4$ towards the Mott insulator to metal transition.


title: Updatable Materialization of Approximate Constraints

abstract: Modern big data applications integrate data from various sources. As a result, these datasets may not satisfy perfect constraints, leading to sparse schema information and non-optimal query performance. The existing approach of PatchIndexes enable the definition of approximate constraints and improve query performance by exploiting the materialized constraint information. As real world data warehouse workloads are often not limited to read-only queries, we enhance the PatchIndex structure towards an update-conscious design in this paper. Therefore, we present a sharded bitmap as the underlying data structure which offers efficient update operations, and describe approaches to maintain approximate constraints under updates, avoiding index recomputations and full table scans. In our evaluation, we prove that PatchIndexes significantly impact query performance while achieving lightweight update support.


title: Continuous Learning in Neural Machine Translation using Bilingual Dictionaries

abstract: While recent advances in deep learning led to significant improvements in machine translation, neural machine translation is often still not able to continuously adapt to the environment. For humans, as well as for machine translation, bilingual dictionaries are a promising knowledge source to continuously integrate new knowledge. However, their exploitation poses several challenges: The system needs to be able to perform one-shot learning as well as model the morphology of source and target language. In this work, we proposed an evaluation framework to assess the ability of neural machine translation to continuously learn new phrases. We integrate one-shot learning methods for neural machine translation with different word representations and show that it is important to address both in order to successfully make use of bilingual dictionaries. By addressing both challenges we are able to improve the ability to translate new, rare words and phrases from 30% to up to 70%. The correct lemma is even generated by more than 90%.


title: Infinitely Deep Bayesian Neural Networks with Stochastic Differential Equations

abstract: We perform scalable approximate inference in continuous-depth Bayesian neural networks. In this model class, uncertainty about separate weights in each layer gives hidden units that follow a stochastic differential equation. We demonstrate gradient-based stochastic variational inference in this infinite-parameter setting, producing arbitrarily-flexible approximate posteriors. We also derive a novel gradient estimator that approaches zero variance as the approximate posterior over weights approaches the true posterior. This approach brings continuous-depth Bayesian neural nets to a competitive comparison against discrete-depth alternatives, while inheriting the memory-efficient training and tunable precision of Neural ODEs.


title: How Far Should We Look Back to Achieve Effective Real-Time Time-Series Anomaly Detection?

abstract: Anomaly detection is the process of identifying unexpected events or ab-normalities in data, and it has been applied in many different areas such as system monitoring, fraud detection, healthcare, intrusion detection, etc. Providing real-time, lightweight, and proactive anomaly detection for time series with neither human intervention nor domain knowledge could be highly valuable since it reduces human effort and enables appropriate countermeasures to be undertaken before a disastrous event occurs. To our knowledge, RePAD (Real-time Proactive Anomaly Detection algorithm) is a generic approach with all above-mentioned features. To achieve real-time and lightweight detection, RePAD utilizes Long Short-Term Memory (LSTM) to detect whether or not each upcoming data point is anomalous based on short-term historical data points. However, it is unclear that how different amounts of historical data points affect the performance of RePAD. Therefore, in this paper, we investigate the impact of different amounts of historical data on RePAD by introducing a set of performance metrics that cover novel detection accuracy measures, time efficiency, readiness, and resource consumption, etc. Empirical experiments based on real-world time series datasets are conducted to evaluate RePAD in different scenarios, and the experimental results are presented and discussed.


title: Complex counterpart of variance in quantum measurements for pre- and post-selected systems

abstract: The variance of an observable in a pre-selected quantum system, which is always real and non-negative, appears as an increase in the probe wave packet width in indirect measurements. Extending this framework to pre- and post-selected systems, we formulate a complex-valued counterpart of the variance called "weak variance." In our formulation, the real and imaginary parts of the weak variance appear as changes in the probe wave packet width in the vertical-horizontal and diagonal-antidiagonal directions, respectively, on the quadrature phase plane. Using an optical system, we experimentally demonstrate these changes in the probe wave packet width caused by the real negative and purely imaginary weak variances. Furthermore, we show that the weak variance can be expressed as the variance of the weak-valued probability distribution in pre- and post-selected systems. These operational and statistical interpretations support the rationality of formulating the weak variance as a complex counterpart of the variance in pre- and post-selected systems.


title: User guide for the hfbcs-qrpa(v1) code

abstract: We briefly explain the structure of the Hartree-Fock-Bardeen-Cooper-Schrieffer (HFBCS) and Quasi-particle Random Phase Approximation (QRPA) code hfbcs-qrpa, highlighting only the differences with the code skyrme_rpa that has been previously published [G. Col\`o, L. Cao, N. Van Giai, and L. Capelli, Comp. Phys. Comm. 184, 142 (2013)]. The code deals with open shell spherical systems and non-spin flip, non-charge-exchange and natural parity $(-1)^l$ excitations.


title: Querying collections of tree-structured records in the presence of within-record referential constraints

abstract: In this paper, we consider a tree-structured data model used in many commercial databases like Dremel, F1, JSON stores. We define identity and referential constraints within each tree-structured record. The query language is a variant of SQL and flattening is used as an evaluation mechanism. We investigate querying in the presence of these constraints, and point out the challenges that arise from taking them into account during query evaluation.


title: Analysis of Interpolation based Image In-painting Approaches

abstract: Interpolation and internal painting are one of the basic approaches in image internal painting, which is used to eliminate undesirable parts that occur in digital images or to enhance faulty parts. This study was designed to compare the interpolation algorithms used in image in-painting in the literature. Errors and noise generated on the colour and grayscale formats of some of the commonly used standard images in the literature were corrected by using Cubic, Kriging, Radial based function and High dimensional model representation approaches and the results were compared using standard image comparison criteria, namely, PSNR (peak signal-to-noise ratio), SSIM (Structural SIMilarity), Mean Square Error (MSE). According to the results obtained from the study, the absolute superiority of the methods against each other was not observed. However, Kriging and RBF interpolation give better results both for numerical data and visual evaluation for image in-painting problems with large area losses.


title: Work-Optimal Parallel Minimum Cuts for Non-Sparse Graphs

abstract: We present the first work-optimal polylogarithmic-depth parallel algorithm for the minimum cut problem on non-sparse graphs. For $m\geq n^{1+\epsilon}$ for any constant $\epsilon>0$, our algorithm requires $O(m \log n)$ work and $O(\log^3 n)$ depth and succeeds with high probability. Its work matches the best $O(m \log n)$ runtime for sequential algorithms [MN STOC 2020, GMW SOSA 2021]. This improves the previous best work by Geissmann and Gianinazzi [SPAA 2018] by $O(\log^3 n)$ factor, while matching the depth of their algorithm. To do this, we design a work-efficient approximation algorithm and parallelize the recent sequential algorithms [MN STOC 2020; GMW SOSA 2021] that exploit a connection between 2-respecting minimum cuts and 2-dimensional orthogonal range searching.


title: Spin-orbit driven ferromagnetism at half moir\'e filling in magic-angle twisted bilayer graphene

abstract: Strong electron correlation and spin-orbit coupling (SOC) provide two non-trivial threads to condensed matter physics. When these two strands of physics come together, a plethora of quantum phenomena with novel topological order have been predicted to emerge in the correlated SOC regime. In this work, we examine the combined influence of electron correlation and SOC on a 2-dimensional (2D) electronic system at the atomic interface between magic-angle twisted bilayer graphene (tBLG) and a tungsten diselenide (\WSe) crystal. In such a structure, strong electron correlation within the moir\'e flatband stabilizes correlated insulating states at both quarter and half-filling, whereas SOC transforms these Mott-like insulators into ferromagnets, evidenced by robust anomalous Hall effect with hysteretic switching behavior. The coupling between spin and valley degrees of freedom is unambiguously demonstrated as the magnetic order is shown to be tunable with an in-plane magnetic field, or a perpendicular electric field. In addition, we examine the influence of SOC on the isospin order and stability of superconductivity. Our findings establish an efficient experimental knob to engineer topological properties of moir\'e bands in twisted bilayer graphene and related systems.


title: High rank invariant subvarieties

abstract: We classify GL(2,R) orbit closures of translation surfaces of rank at least half the genus plus 1.


title: Source-dependent properties of two slow solar wind states

abstract: Two states of the slow solar wind are identified from in-situ measurements by Parker Solar Probe (PSP) inside 50 solar radii from the Sun. At such distances the wind measured at PSP has not yet undergone significant transformation related to the expansion and propagation of the wind. We focus in this study on the properties of the quiet solar wind with no magnetic switchbacks. The two states differ by their plasma beta, flux and magnetic pressure. PSP's magnetic connectivity established with Potential Field Source Surface (PFSS) reconstructions, tested against extreme ultraviolet (EUV) and white-light imaging, reveals the two states correspond to a transition from a streamer to an equatorial coronal hole. The expansion factors of magnetic field lines in the streamer are 20 times greater than those rooted near the center of the coronal hole. The very different expansion rates of the magnetic field result in different magnetic pressures measured by PSP in the two plasma states. Solar wind simulations run along these differing flux tubes reproduce the slower and denser wind measured in the streamer and the more tenuous wind measured in the coronal hole. Plasma heating is more intense at the base of the streamer field lines rooted near the boundary of the equatorial hole than those rooted closer to the center of the hole. This results in a higher wind flux driven inside the streamer than deeper inside the equatorial hole.


title: Application of Genetic Algorithm to Estimate the Large Angular Scale Features of Cosmic Microwave Background

abstract: Genetic Algorithm (GA) -- motivated by natural evolution -- is a robust method to estimate the global optimal solutions of problems involving multiple objective functions. In this article, for the first time, we apply GA to reconstruct the CMB temperature anisotropy map over large angular scales of the sky using (internal) linear combination (ILC) of the final-year WMAP and Planck satellite observations. To avoid getting trapped into a local minimum, we implement the GA with generous diversity in the populations by selecting pairs with diverse fitness coefficients and by introducing a small but significant amount of mutation of genes. We find that the new GA-ILC method produces a clean map which agrees very well with that obtained using the exact analytical expression of weights in ILC. By performing extensive Monte Carlo simulations of the CMB reconstruction using the GA-ILC algorithm, we find that residual foregrounds in the cleaned map are minimal and tend to occupy localized regions along the galactic plane. The CMB angular power spectrum shows no indication of any bias in the entire multipole range $2 \leq \ell \leq 32$ studied in this work. The error in the CMB angular power spectrum is also minimal and given entirely by the cosmic-variance-induced error. Our results agree well with those obtained by various other reconstruction methods by different research groups. This problem-independent robust GA-ILC method provides a flexible way towards the complex and challenging task of CMB component reconstruction in cosmology.


title: User manual for bch, a program for the fast computation of the Baker-Campbell-Hausdorff and similar series

abstract: This manual describes bch, an efficient program written in the C programming language for the fast computation of the Baker-Campbell-Hausdorff (BCH) and similar Lie series. The Lie series can be represented in the Lyndon basis, in the classical Hall basis, or in the right-normed basis of E.S. Chibrikov. In the Lyndon basis, which proves to be particularly efficient for this purpose, the computation of 111013 coefficients for the BCH series up to terms of degree 20 takes less than half a second on an ordinary personal computer and requires negligible 11MB of memory. Up to terms of degree 30, which is the maximum degree the program can handle, the computation of 74248451 coefficients takes 55 hours but still requires only a modest 5.5GB of memory.


title: Bayesian Neural Network Priors Revisited

abstract: Isotropic Gaussian priors are the de facto standard for modern Bayesian neural network inference. However, it is unclear whether these priors accurately reflect our true beliefs about the weight distributions or give optimal performance. To find better priors, we study summary statistics of neural network weights in networks trained using stochastic gradient descent (SGD). We find that convolutional neural network (CNN) and ResNet weights display strong spatial correlations, while fully connected networks (FCNNs) display heavy-tailed weight distributions. We show that building these observations into priors can lead to improved performance on a variety of image classification datasets. Surprisingly, these priors mitigate the cold posterior effect in FCNNs, but slightly increase the cold posterior effect in ResNets.


title: Conjugate Logic

abstract: We propose a conjugate logic that can capture the behavior of quantum and quantum-like systems. The proposal is similar to the more generic concept of epistemic logic: it encodes knowledge or perhaps more correctly, predictions about outcomes of future observations on some systems. For a quantum system, these predictions are statements about future outcomes of measurements performed on specific degrees of freedom of the system. The proposed logic will include propositions and their relations including connectives, but importantly also transformations between propositions on conjugate degrees of freedom of the systems. A key point is the addition of a transformation that allows to convert propositions about single systems into propositions about correlations between systems. We will see that subtle choices of the properties of the transformations lead to drastically different underlying mathematical models; one choice gives stabilizer quantum mechanics, while another choice gives Spekkens' toy theory. This points to a crucial basic property of quantum and quantum-like systems that can be handled within the present conjugate logic by adjusting the mentioned choice. It also enables a discussion on what behaviors are properly quantum or only quantum-like, relating to that choice and how it manifests in the system under scrutiny.


title: Shrinkage Bayesian Causal Forests for Heterogeneous Treatment Effects Estimation

abstract: This paper develops a sparsity-inducing version of Bayesian Causal Forests, a recently proposed nonparametric causal regression model that employs Bayesian Additive Regression Trees and is specifically designed to estimate heterogeneous treatment effects using observational data. The sparsity-inducing component we introduce is motivated by empirical studies where not all the available covariates are relevant, leading to different degrees of sparsity underlying the surfaces of interest in the estimation of individual treatment effects. The extended version presented in this work, which we name Shrinkage Bayesian Causal Forest, is equipped with an additional pair of priors allowing the model to adjust the weight of each covariate through the corresponding number of splits in the tree ensemble. These priors improve the model's adaptability to sparse data generating processes and allow to perform fully Bayesian feature shrinkage in a framework for treatment effects estimation, and thus to uncover the moderating factors driving heterogeneity. In addition, the method allows prior knowledge about the relevant confounding covariates and the relative magnitude of their impact on the outcome to be incorporated in the model. We illustrate the performance of our method in simulated studies, in comparison to Bayesian Causal Forest and other state-of-the-art models, to demonstrate how it scales up with an increasing number of covariates and how it handles strongly confounded scenarios. Finally, we also provide an example of application using real-world data.


title: Fireball characteristics derivable from acoustic data

abstract: Near field acoustical signals from fireballs (ranges<200 km), when detected by dense ground networks, may be used to estimate the orientation of the trajectory of a fireball (Pujol et al., 2005) as well as fragmentation locations (Kalenda et al., 2014; Edwards and Hildebrand, 2004). Distinguishing ballistic arrivals (from the cylindrical shock of the fireball)from fragmentation generated signals (quasi-spherical sources) remains a challenge, but are obtainable through analysis of the acoustic path and the timing observed at ground instruments. Here we describe an integrated computer code, termed the Bolide Acoustic Modelling program or BAM, to estimate fireball trajectories and energetics. We develop a new methodology for measuring energy release from bolide fragmentation episodes solely from acoustic measurements and incorporate this into BAM. We also explore the sensitivity of seismo-acoustic fireball solutions and energy estimates to uncertainty in the underlying atmospheric model. Applying BAM to the Stubenberg meteorite producing fireball, we find the total fireball energy from ballistic arrivals to be approximately $5 \times 10^{10}$J which compares favorably to the optical estimate of $4.36 \times 10^{10}$J. The combined fragmentation energy of the Stubenberg event from acoustic data was found to be $1.47^{+0.28}_{-0.12} \times 10^{10}$J, roughly one third of the ballistic or optical total energy. We also show that measuring fireball velocities from acoustic data alone is very challenging but may be possible for slow, deeply penetrating fireballs with shallow entry angles occurring over dense seismic/infrasound networks.


title: Estimation and Applications of Quantiles in Deep Binary Classification

abstract: Quantile regression, based on check loss, is a widely used inferential paradigm in Econometrics and Statistics. The conditional quantiles provide a robust alternative to classical conditional means, and also allow uncertainty quantification of the predictions, while making very few distributional assumptions. We consider the analogue of check loss in the binary classification setting. We assume that the conditional quantiles are smooth functions that can be learnt by Deep Neural Networks (DNNs). Subsequently, we compute the Lipschitz constant of the proposed loss, and also show that its curvature is bounded, under some regularity conditions. Consequently, recent results on the error rates and DNN architecture complexity become directly applicable. We quantify the uncertainty of the class probabilities in terms of prediction intervals, and develop individualized confidence scores that can be used to decide whether a prediction is reliable or not at scoring time. By aggregating the confidence scores at the dataset level, we provide two additional metrics, model confidence, and retention rate, to complement the widely used classifier summaries. We also the robustness of the proposed non-parametric binary quantile classification framework are also studied, and we demonstrate how to obtain several univariate summary statistics of the conditional distributions, in particular conditional means, using smoothed conditional quantiles, allowing the use of explanation techniques like Shapley to explain the mean predictions. Finally, we demonstrate an efficient training regime for this loss based on Stochastic Gradient Descent with Lipschitz Adaptive Learning Rates (LALR).


title: The $\alpha \to 1$ Limit of the Sharp Quantum R\'enyi Divergence

abstract: Fawzi and Fawzi recently defined the sharp R\'enyi divergence, $D_\alpha^\#$, for $\alpha \in (1, \infty)$, as an additional quantum R\'enyi divergence with nice mathematical properties and applications in quantum channel discrimination and quantum communication. One of their open questions was the limit ${\alpha} \to 1$ of this divergence. By finding a new expression of the sharp divergence in terms of a minimization of the geometric R\'enyi divergence, we show that this limit is equal to the Belavkin-Staszewski relative entropy. Analogous minimizations of arbitrary generalized divergences lead to a new family of generalized divergences that we call kringel divergences, and for which we prove various properties including the data-processing inequality.


title: Generalized persistence and graded structures

abstract: We investigate the correspondence between generalized persistence modules and graded modules in the case the indexing set has a monoid action. We introduce the notion of an action category over a monoid graded ring. We show that the category of additive functors from this category to the category of Abelian groups is isomorphic to the category of modules graded over the set with a monoid action, and to the category of unital modules over a certain smash product. Furthermore, when the indexing set is a poset, we provide a new characterization for a generalized persistence module being finitely presented.


title: Improving Zero-shot Neural Machine Translation on Language-specific Encoders-Decoders

abstract: Recently, universal neural machine translation (NMT) with shared encoder-decoder gained good performance on zero-shot translation. Unlike universal NMT, jointly trained language-specific encoders-decoders aim to achieve universal representation across non-shared modules, each of which is for a language or language family. The non-shared architecture has the advantage of mitigating internal language competition, especially when the shared vocabulary and model parameters are restricted in their size. However, the performance of using multiple encoders and decoders on zero-shot translation still lags behind universal NMT. In this work, we study zero-shot translation using language-specific encoders-decoders. We propose to generalize the non-shared architecture and universal NMT by differentiating the Transformer layers between language-specific and interlingua. By selectively sharing parameters and applying cross-attentions, we explore maximizing the representation universality and realizing the best alignment of language-agnostic information. We also introduce a denoising auto-encoding (DAE) objective to jointly train the model with the translation task in a multi-task manner. Experiments on two public multilingual parallel datasets show that our proposed model achieves a competitive or better results than universal NMT and strong pivot baseline. Moreover, we experiment incrementally adding new language to the trained model by only updating the new model parameters. With this little effort, the zero-shot translation between this newly added language and existing languages achieves a comparable result with the model trained jointly from scratch on all languages.


title: Reflected BSDEs in non-convex domains

abstract: This paper establishes the well-posedness of reflected backward stochastic differential equations in the non-convex domains that satisfy a weaker version of the star-shaped property. The main results are established (i) in a Markovian framework with H\"older-continuous generator and terminal condition and (ii) in a general setting under a smallness assumption on the input data. We also investigate the connections between this well-posedness result and the theory of martingales on manifolds.


title: Fuzzing Symbolic Expressions

abstract: Recent years have witnessed a wide array of results in software testing, exploring different approaches and methodologies ranging from fuzzers to symbolic engines, with a full spectrum of instances in between such as concolic execution and hybrid fuzzing. A key ingredient of many of these tools is Satisfiability Modulo Theories (SMT) solvers, which are used to reason over symbolic expressions collected during the analysis. In this paper, we investigate whether techniques borrowed from the fuzzing domain can be applied to check whether symbolic formulas are satisfiable in the context of concolic and hybrid fuzzing engines, providing a viable alternative to classic SMT solving techniques. We devise a new approximate solver, FUZZY-SAT, and show that it is both competitive with and complementary to state-of-the-art solvers such as Z3 with respect to handling queries generated by hybrid fuzzers.


title: Post-quantum steering is a stronger-than-quantum resource for information processing

abstract: We present the first instance where post-quantum steering is a stronger-than-quantum resource for information processing -- remote state preparation. In addition, we show that the phenomenon of post-quantum steering is not just a mere mathematical curiosity allowed by the no-signalling principle, but it may arise within compositional theories beyond quantum theory, hence making its study fundamentally relevant. We show these results by formulating a new compositional general probabilistic theory -- which we call Witworld -- with strong post-quantum features, which proves to be a intuitive and useful tool for exploring steering and its applications beyond the quantum realm.


title: Anharmonic Infrared Spectra of Thermally Excited Pyrene(C$_{16}$H$_{10}$): the combined view of DFT-based GVPT2 with AnharmonicCaOs and approximate DFT molecular dynamics with DemonNano

abstract: The study of the Aromatic Infrared Bands (AIBs) in astronomical environments has opened interesting spectroscopic questions on the effect of anharmonicity on the infrared (IR) spectrum of hot polycyclic aromatic hydrocarbons (PAHs) and related species in isolated conditions. The forthcoming James Webb Space Telescope will unveil unprecedented spatial and spectral details in the AIB spectrum; significant advancement is thus necessary now to model the infrared emission of PAHs, their presumed carriers, with enough detail to exploit the information content of the AIBs. This requires including anharmonicity in such models, and to do so systematically for all species included, requiring a difficult compromise between accuracy and efficiency. We performed a benchmark study to compare the performances of two methods in calculating anharmonic spectra, comparing them to available experimental data. One is a full quantum method, AnharmoniCaOs, relying on an ab initio potential, and the other relies on Molecular Dynamics simulations using a Density Functional based Tight Binding potential. The first one is found to be very accurate and detailed, but it becomes computationally very expensive for increasing temperature; the second is faster and can be used for arbitrarily high temperatures, but is less accurate. Still, its results can be used to model the evolution with temperature of isolated bands. We propose a new recipe to model anharmonic AIB emission using minimal assumptions on the general behaviour of band positions and widths with temperature, which can be defined by a small number of empirical parameters. Modelling accuracy will depend critically on these empirical parameters, allowing for an incremental improvement in model results, as better estimates become gradually available.

categories: astro-ph.GA physics.atm-clus physics.chem-ph physics.comp-ph


title: Reviving Iterative Training with Mask Guidance for Interactive Segmentation

abstract: Recent works on click-based interactive segmentation have demonstrated state-of-the-art results by using various inference-time optimization schemes. These methods are considerably more computationally expensive compared to feedforward approaches, as they require performing backward passes through a network during inference and are hard to deploy on mobile frameworks that usually support only forward passes. In this paper, we extensively evaluate various design choices for interactive segmentation and discover that new state-of-the-art results can be obtained without any additional optimization schemes. Thus, we propose a simple feedforward model for click-based interactive segmentation that employs the segmentation masks from previous steps. It allows not only to segment an entirely new object, but also to start with an external mask and correct it. When analyzing the performance of models trained on different datasets, we observe that the choice of a training dataset greatly impacts the quality of interactive segmentation. We find that the models trained on a combination of COCO and LVIS with diverse and high-quality annotations show performance superior to all existing models. The code and trained models are available at https://github.com/saic-vul/ritm_interactive_segmentation.


title: On the Application of BAC-NOMA to 6G umMTC

abstract: This letter studies the application of backscatter communications (BackCom) assisted non-orthogonal multiple access (BAC-NOMA) to the envisioned sixth-generation (6G) ultra-massive machine type communications (umMTC). In particular, the proposed BAC-NOMA transmission scheme can realize simultaneous energy and spectrum cooperation between uplink and downlink users, which is important to support massive connectivity and stringent energy constraints in umMTC. Furthermore, a resource allocation problem for maximizing the uplink throughput and suppressing the interference between downlink and uplink transmission is formulated as an optimization problem and the corresponding optimal resource allocation policy is obtained. Computer simulations are provided to demonstrate the superior performance of BAC-NOMA.


title: A Computability Perspective on (Verified) Machine Learning

abstract: There is a strong consensus that combining the versatility of machine learning with the assurances given by formal verification is highly desirable. It is much less clear what verified machine learning should mean exactly. We consider this question from the (unexpected?) perspective of computable analysis. This allows us to define the computational tasks underlying verified ML in a model-agnostic way, and show that they are in principle computable.


title: Linear programming approach to nonparametric inference under shape restrictions: with an application to regression kink designs

abstract: We develop a novel method of constructing confidence bands for nonparametric regression functions under shape constraints. This method can be implemented via a linear programming, and it is thus computationally appealing. We illustrate a usage of our proposed method with an application to the regression kink design (RKD). Econometric analyses based on the RKD often suffer from wide confidence intervals due to slow convergence rates of nonparametric derivative estimators. We demonstrate that economic models and structures motivate shape restrictions, which in turn contribute to shrinking the confidence interval for an analysis of the causal effects of unemployment insurance benefits on unemployment durations.


title: Disturbing Reinforcement Learning Agents with Corrupted Rewards

abstract: Reinforcement Learning (RL) algorithms have led to recent successes in solving complex games, such as Atari or Starcraft, and to a huge impact in real-world applications, such as cybersecurity or autonomous driving. In the side of the drawbacks, recent works have shown how the performance of RL algorithms decreases under the influence of soft changes in the reward function. However, little work has been done about how sensitive these disturbances are depending on the aggressiveness of the attack and the learning exploration strategy. In this paper, we propose to fill this gap in the literature analyzing the effects of different attack strategies based on reward perturbations, and studying the effect in the learner depending on its exploration strategy. In order to explain all the behaviors, we choose a sub-class of MDPs: episodic, stochastic goal-only-rewards MDPs, and in particular, an intelligible grid domain as a benchmark. In this domain, we demonstrate that smoothly crafting adversarial rewards are able to mislead the learner, and that using low exploration probability values, the policy learned is more robust to corrupt rewards. Finally, in the proposed learning scenario, a counterintuitive result arises: attacking at each learning episode is the lowest cost attack strategy.


title: A taxonomy for quality in simulation-based development and testing of automated driving systems

abstract: Ensuring the quality of automated driving systems is a major challenge the automotive industry is facing. In this context, quality defines the degree to which an object meets expectations and requirements. Especially, automated vehicles at SAE level 4 and 5 will be expected to operate safely in various contexts and complex situations without misconduct. Thus, a systematic approach is needed to show their safe operation. A way to address this challenge is simulation-based testing as pure physical testing is not feasible. During simulation-based testing, the data used to evaluate the actual quality of an automated driving system are generated using a simulation. However, to rely on these simulation data, the overall simulation, which also includes its simulation models, must provide a certain quality level. This quality level depends on the intended purpose for which the generated simulation data should be used. Therefore, three categories of quality can be considered: quality of the automated driving system and simulation quality, consisting of simulation model quality and scenario quality. Hence, quality must be determined and evaluated in various process steps in developing and testing automated driving systems, the overall simulation, and the simulation models used for the simulation. In this paper, we propose a taxonomy to serve a better understanding of the concept of quality in the development and testing process to have a clear separation and insight where further testing is needed -- both in terms of automated driving systems and simulation, including their simulation models and scenarios used for testing.


title: Generalization Bounds for Meta-Learning via PAC-Bayes and Uniform Stability

abstract: We are motivated by the problem of providing strong generalization guarantees in the context of meta-learning. Existing generalization bounds are either challenging to evaluate or provide vacuous guarantees in even relatively simple settings. We derive a probably approximately correct (PAC) bound for gradient-based meta-learning using two different generalization frameworks in order to deal with the qualitatively different challenges of generalization at the "base" and "meta" levels. We employ bounds for uniformly stable algorithms at the base level and bounds from the PAC-Bayes framework at the meta level. The result of this approach is a novel PAC bound that is tighter when the base learner adapts quickly, which is precisely the goal of meta-learning. We show that our bound provides a tighter guarantee than other bounds on a toy non-convex problem on the unit sphere and a text-based classification example. We also present a practical regularization scheme motivated by the bound in settings where the bound is loose and demonstrate improved performance over baseline techniques.


title: VSync: Push-Button Verification and Optimization for Synchronization Primitives on Weak Memory Models (Technical Report)

abstract: This technical report contains material accompanying our work with same title published at ASPLOS'21. We start in Sec. 1 with a detailed presentation of the core innovation of this work, Await Model Checking (AMC). The correctness proofs of AMC can be found in Sec. 2. Next, we discuss three study cases in Sec. 3, presenting bugs found and challenges encountered when applying VSync to existing code bases. Finally, in Sec. 4 we describe the setup details of our evaluation and report further experimental results.


title: Outdoor inverse rendering from a single image using multiview self-supervision

abstract: In this paper we show how to perform scene-level inverse rendering to recover shape, reflectance and lighting from a single, uncontrolled image using a fully convolutional neural network. The network takes an RGB image as input, regresses albedo, shadow and normal maps from which we infer least squares optimal spherical harmonic lighting coefficients. Our network is trained using large uncontrolled multiview and timelapse image collections without ground truth. By incorporating a differentiable renderer, our network can learn from self-supervision. Since the problem is ill-posed we introduce additional supervision. Our key insight is to perform offline multiview stereo (MVS) on images containing rich illumination variation. From the MVS pose and depth maps, we can cross project between overlapping views such that Siamese training can be used to ensure consistent estimation of photometric invariants. MVS depth also provides direct coarse supervision for normal map estimation. We believe this is the first attempt to use MVS supervision for learning inverse rendering. In addition, we learn a statistical natural illumination prior. We evaluate performance on inverse rendering, normal map estimation and intrinsic image decomposition benchmarks.


title: A Philosophical Understanding of Representation for Neuroscience

abstract: Neuroscientists often describe neural activity as a representation of something, or claim to have found evidence for a neural representation. But what do these statements mean? The reasons to call some neural activity a representation and the assumptions that come with this term are not generally made clear from its common uses in neuroscience. Representation is a central concept in philosophy of mind, with a rich history going back to the ancient period. In order to clarify its usage in neuroscience, here we advance a link between the connotations of this term across these disciplines. We draw on a broad range of discourse in philosophy to distinguish three key aspects of representation: correspondence, functional role, and teleology. We argue that each of these aspects are implied by the explanatory role the term plays in neuroscience. However, evidence related to all three aspects is rarely presented or discussed in the course of individual studies that aim to identify representations. Overlooking the significance of all three aspects hinders communication in neuroscience, as it obscures the limitations of experimental paradigms and conceals gaps in our understanding of the phenomena of primary interest. Working from this three-part view, we discuss how to move toward clearer communication about representations in the brain.


title: Pareto Optimal Model Selection in Linear Bandits

abstract: We study model selection in linear bandits, where the learner must adapt to the dimension (denoted by $d_\star$) of the smallest hypothesis class containing the true linear model while balancing exploration and exploitation. Previous papers provide various guarantees for this model selection problem, but have limitations; i.e., the analysis requires favorable conditions that allow for inexpensive statistical testing to locate the right hypothesis class or are based on the idea of "corralling" multiple base algorithms, which often performs relatively poorly in practice. These works also mainly focus on upper bounds. In this paper, we establish the first lower bound for the model selection problem. Our lower bound implies that, even with a fixed action set, adaptation to the unknown dimension $d_\star$ comes at a cost: There is no algorithm that can achieve the regret bound $\widetilde{O}(\sqrt{d_\star T})$ simultaneously for all values of $d_\star$. We propose Pareto optimal algorithms that match the lower bound. Empirical evaluations show that our algorithm enjoys superior performance compared to existing ones.


title: The Dirichlet-to-Neumann map, the boundary Laplacian, and H\"ormander's rediscovered manuscript

abstract: How close is the Dirichlet-to-Neumann (DtN) map to the square root of the corresponding boundary Laplacian? This question has been actively investigated in recent years. Somewhat surprisingly, a lot of techniques involved can be traced back to a newly rediscovered manuscript of H\"ormander from the 1950s. We present H\"ormander's approach and its applications, with an emphasis on eigenvalue estimates and spectral asymptotics. In particular, we obtain results for the DtN maps on non-smooth boundaries in the Riemannian setting, the DtN operators for the Helmholtz equation and the DtN operators on differential forms.