title: Semi-parametric TEnsor Factor Analysis by Iteratively Projected Singular Value Decomposition

abstract: This paper introduces a general framework of Semi-parametric TEnsor Factor Analysis (STEFA) that focuses on the methodology and theory of low-rank tensor decomposition with auxiliary covariates. Semi-parametric TEnsor Factor Analysis models extend tensor factor models by incorporating auxiliary covariates in the loading matrices. We propose an algorithm of iteratively projected singular value decomposition (IP-SVD) for the semi-parametric estimation. It iteratively projects tensor data onto the linear space spanned by the basis functions of covariates and applies singular value decomposition on matricized tensors over each mode. We establish the convergence rates of the loading matrices and the core tensor factor. The theoretical results only require a sub-exponential noise distribution, which is weaker than the assumption of sub-Gaussian tail of noise in the literature. Compared with the Tucker decomposition, IP-SVD yields more accurate estimators with a faster convergence rate. Besides estimation, we propose several prediction methods with new covariates based on the STEFA model. On both synthetic and real tensor data, we demonstrate the efficacy of the STEFA model and the IP-SVD algorithm on both the estimation and prediction tasks.


title: On integral weight spectra of the MDS codes cosets of weight 1, 2, and 3

abstract: The weight of a coset of a code is the smallest Hamming weight of any vector in the coset. For a linear code of length $n$, we call integral weight spectrum the overall numbers of weight $w$ vectors, $0\le w\le n$, in all the cosets of a fixed weight. For maximum distance separable (MDS) codes, we obtained new convenient formulas of integral weight spectra of cosets of weight 1 and 2. Also, we give the spectra for the weight 3 cosets of MDS codes with minimum distance $5$ and covering radius $3$.


title: Modeling of extended atmospheres with temperatures below 40000K

abstract: We calculate models of extended stellar atmospheres with a temperature in the range of 12000-40000K and a mass loss rate of $10^{-6}-10^{-4} M_{\odot}$ yr$^{-1}$. A large number of objects with emission spectra, such as luminous blue variables (LBV), FeII - emission line stars, Of/late-WN stars, and even ultraluminous X-ray sources (ULXs) often have effective temperatures in this range. The paper presents the results of model grids calculating in the form of equivalent width diagrams for the selected lines of hydrogen, He, Si, and Fe, as well as the results of studies of some emission objects using the calculated models.


title: Adversarial Machine Learning Attacks and Defense Methods in the Cyber Security Domain

abstract: In recent years machine learning algorithms, and more specifically deep learning algorithms, have been widely used in many fields, including cyber security. However, machine learning systems are vulnerable to adversarial attacks, and this limits the application of machine learning, especially in non-stationary, adversarial environments, such as the cyber security domain, where actual adversaries (e.g., malware developers) exist. This paper comprehensively summarizes the latest research on adversarial attacks against security solutions based on machine learning techniques and illuminates the risks they pose. First, the adversarial attack methods are characterized based on their stage of occurrence, and the attacker's goals and capabilities. Then, we categorize the applications of adversarial attack and defense methods in the cyber security domain. Finally, we highlight some characteristics identified in recent research and discuss the impact of recent advancements in other adversarial learning domains on future research directions in the cyber security domain. This paper is the first to discuss the unique challenges of implementing end-to-end adversarial attacks in the cyber security domain, map them in a unified taxonomy, and use the taxonomy to highlight future research directions.


title: Atomistic modelling of near-crack-tip plasticity

abstract: An atomistic model of near-crack-tip plasticity on a square lattice under anti-plane shear kinematics is formulated and studied. The model is based upon a new geometric and functional framework of a lattice manifold complex, which ensures that the crack surface is fully taken into account, while preserving the crucial notion of duality. As a result, existence of locally stable equilibrium configurations containing both a crack opening and dislocations is established. Notably, with the boundary in the form of a crack surface accounted for, no minimum separation between a dislocation core and the crack surface or the crack tip is required. The work presented here constitutes a foundation for several further studies aiming to put the phenomenon of near-crack-tip plasticity on a rigorous footing.


title: Bardeen Stellar Structures with Karmarkar Condition

abstract: Current study is focussed to discuss the existence of a new family of compact star solutions by adopting the Karmarkar condition in the background of Bardeen black hole geometry. For this purpose, we consider static spherically symmetric spacetime with anisotropic fluid distribution in the presence of electric charge. We consider a specific model of $g_{rr}$ metric function, to describe a new family of solutions which satisfies the Karmarkar condition. Further, we investigate the interior solutions for two different models of compact stars with observational mass and radii, i.e., $(M=1.77M_{\odot}, \;R_{b}=9.56km)$ and $(M=1.97M_{\odot}, \;R_{b}=10.3km)$. It is found that these solutions fulfill all the necessary conditions for a charged star. Through graphical discussion, it is noticed that our calculated solutions are physically arguable with a best degree of accuracy for $n\in[1.8,7)$, where parameter $n$ is involved in the model under discussion. However, it is perceived that the presented model violates all the physical conditions for $n\in\{2,4,6\}$. Finally, it is concluded that the parameter $n$ has a strong impact on the obtained solutions in the context of Bardeen stellar structures.


title: Charge-voltage relation for a universal capacitor

abstract: Most capacitors do not satisfy the conventional assumption of a constant capacitance. They exhibit memory which is often described by a time-varying capacitance. It is shown that the classical relation, $Q\left(t\right)=CV\left(t\right)$, that relates the charge, $Q$, with the capacitance, $C$, and the voltage, $V$, is not applicable for capacitors with a time-varying capacitance. The expression for the current, $dQ/dt$, that is subsequently obtained following the substitution of $C$ by $C\left(t\right)$ in the classical relation corresponds to an inconsistent circuit. In order to address the inconsistency, I propose a charge-voltage relation according to which the charge on a capacitor is expressed by the convolution of its time-varying capacitance with the first-order time-derivative of the applied voltage, i.e., $Q\left(t\right)=C\left(t\right)\ast dV/dt$. This relation corresponds to the universal capacitor which is also known as the fractional capacitor among the fractional calculus community. Since the fractional capacitor has an inherent connection with the universal dielectric response that is expressed by the century old Curie-von Schweidler law, the finding extends to the study of dielectrics as well.

categories: physics.app-ph cond-mat.mtrl-sci cs.SY eess.SY


title: Assessing External Validity Over Worst-case Subpopulations

abstract: Study populations are typically sampled from limited points in space and time, and marginalized groups are underrepresented. To assess the external validity of randomized and observational studies, we propose and evaluate the worst-case treatment effect (WTE) across all subpopulations of a given size, which guarantees positive findings remain valid over subpopulations. We develop a semiparametrically efficient estimator for the WTE that analyzes the external validity of the augmented inverse propensity weighted estimator for the average treatment effect. Our cross-fitting procedure leverages flexible nonparametric and machine learning-based estimates of nuisance parameters and is a regular root-$n$ estimator even when nuisance estimates converge more slowly. On real examples where external validity is of core concern, our proposed framework guards against brittle findings that are invalidated by unanticipated population shifts.


title: Bound-state spectra of field theories through separation of external and internal dynamics

abstract: A general strategy is formulated for computing bound state spectra in the framework of functional renormalisation group (FRG). Dynamical "coordinates" characterising bound states are introduced as coupling parameters in the $n$-point functions of effective fields representing the bound states in an extended effective action functional. Their scale dependence is computed with functional renormalisation group equations. In the infrared an interaction potential among the constituting fields is extracted as smooth function of the coupling parameters. Eventually quantised bound state solutions are found by solving the Schr\"odinger eigenvalue problem formulated for the coupling parameters transmuted into coordinates. The proposed strategy is exemplified through the analysis of a recently published FRG study of the one-flavor chiral Nambu--Jona-Lasinio model.


title: Elimination distance to bounded degree on planar graphs

abstract: We study the graph parameter elimination distance to bounded degree, which was introduced by Bulian and Dawar in their study of the parameterized complexity of the graph isomorphism problem. We prove that the problem is fixed-parameter tractable on planar graphs, that is, there exists an algorithm that given a planar graph $G$ and integers $d$ and $k$ decides in time $f(k,d)\cdot n^c$ for a computable function~$f$ and constant $c$ whether the elimination distance of $G$ to the class of degree $d$ graphs is at most $k$.


title: Analysis of Neural Clusters due to Deep Brain Stimulation Pulses

abstract: Deep brain stimulation (DBS) is an established method for treating pathological conditions such as Parkinson's disease, dystonia, Tourette syndrome, and essential tremor. While the precise mechanisms which underly the effectiveness of DBS are not fully understood, theoretical studies of populations of neural oscillators stimulated by periodic pulses suggest that this may be related to clustering, in which subpopulations of the neurons are synchronized, but the subpopulations are desynchronized with respect to each other. The details of the clustering behavior depend on the frequency and amplitude of the stimulation in a complicated way. In the present study, we investigate how the number of clusters, their stability properties, and their basins of attraction can be understood in terms of one-dimensional maps defined on the circle. Moreover, we generalize this analysis to stimuli that consist of pulses with alternating properties, which provide additional degrees of freedom in the design of DBS stimuli. Our results illustrate how the complicated properties of clustering behavior for periodically forced neural oscillator populations can be understood in terms of a much simpler dynamical system.


title: Business Email Compromise (BEC) and Cyberpsychology

abstract: The paper gives a brief introduction about what BEC (Business Email Compromise) is and why we should be concerned about. In addition, it presents 2 examples, Ubiquity and Peebles Media Group, which have been chosen to analyse the phenomena of BEC and underpin how universal BEC threat is for all companies. The psychology behind this scam has been, then, studied. In particular, the Big Five Framework has been analysed to understand how personality traits play an important role in Social Engineering-based attacks. Furthermore, the 6 basic principles of influence, by Cialdini, have been presented to show which strategies are adopted in such scam. The paper follows with the analysis of the BEC impacts, the incidents evaluation and, finally, with the description of some precautions, that companies should undertake in order to mitigate the likelihood of a Business Email Compromise.


title: Partial Order Resolution of Event Logs for Process Conformance Checking

abstract: While supporting the execution of business processes, information systems record event logs. Conformance checking relies on these logs to analyze whether the recorded behavior of a process conforms to the behavior of a normative specification. A key assumption of existing conformance checking techniques, however, is that all events are associated with timestamps that allow to infer a total order of events per process instance. Unfortunately, this assumption is often violated in practice. Due to synchronization issues, manual event recordings, or data corruption, events are only partially ordered. In this paper, we put forward the problem of partial order resolution of event logs to close this gap. It refers to the construction of a probability distribution over all possible total orders of events of an instance. To cope with the order uncertainty in real-world data, we present several estimators for this task, incorporating different notions of behavioral abstraction. Moreover, to reduce the runtime of conformance checking based on partial order resolution, we introduce an approximation method that comes with a bounded error in terms of accuracy. Our experiments with real-world and synthetic data reveal that our approach improves accuracy over the state-of-the-art considerably.


title: Dynamics and Aerial Attitude Control for Rapid Emergency Deployment of the Agile Ground Robot AGRO

abstract: In this work we present a Four-Wheeled Independent Drive and Steering (4WIDS) robot named AGRO and a method of controlling its orientation while airborne using wheel reaction torques. This is the first documented use of independently steerable wheels to both drive on the ground and achieve aerial attitude control when thrown. Inspired by a cat's self-righting reflex, this capability was developed to allow emergency response personnel to rapidly deploy AGRO by throwing it over walls and fences or through windows without the risk of it landing upside down. It also allows AGRO to drive off of ledges and ensure it lands on all four wheels. We have demonstrated a successful thrown deployment of AGRO. A novel parametrization and singularity analysis of 4WIDS kinematics reveals independent yaw authority with simultaneous adjustment of the ratio between roll and pitch authority. Simple PD controllers allow for stabilization of roll, pitch, and yaw. These controllers were tested in a simulation using derived dynamic equations of motion, then implemented on the AGRO prototype. An experiment comparing a controlled and non-controlled fall was conducted in which AGRO was dropped from a height of 0.85 m with an initial roll and pitch angle of 16 degrees and -23 degrees respectively. With the controller enabled, AGRO can use the reaction torque from its wheels to stabilize its orientation within 402 milliseconds.


title: Selective Dyna-style Planning Under Limited Model Capacity

abstract: In model-based reinforcement learning, planning with an imperfect model of the environment has the potential to harm learning progress. But even when a model is imperfect, it may still contain information that is useful for planning. In this paper, we investigate the idea of using an imperfect model selectively. The agent should plan in parts of the state space where the model would be helpful but refrain from using the model where it would be harmful. An effective selective planning mechanism requires estimating predictive uncertainty, which arises out of aleatoric uncertainty, parameter uncertainty, and model inadequacy, among other sources. Prior work has focused on parameter uncertainty for selective planning. In this work, we emphasize the importance of model inadequacy. We show that heteroscedastic regression can signal predictive uncertainty arising from model inadequacy that is complementary to that which is detected by methods designed for parameter uncertainty, indicating that considering both parameter uncertainty and model inadequacy may be a more promising direction for effective selective planning than either in isolation.


title: Attention-based Joint Detection of Object and Semantic Part

abstract: In this paper, we address the problem of joint detection of objects like dog and its semantic parts like face, leg, etc. Our model is created on top of two Faster-RCNN models that share their features to perform a novel Attention-based feature fusion of related Object and Part features to get enhanced representations of both. These representations are used for final classification and bounding box regression separately for both models. Our experiments on the PASCAL-Part 2010 dataset show that joint detection can simultaneously improve both object detection and part detection in terms of mean Average Precision (mAP) at IoU=0.5.


title: High-resolution Spectra for a Wide Range of Habitable Zone Planets around Sun-like Stars

abstract: The search for life in the universe is currently focused on Earth-analog planets. However, we should be prepared to find a diversity of terrestrial exoplanets not only in terms of host star but also in terms of surface environment. Simulated high-resolution spectra of habitable planets covering a wide parameter space are essential in training retrieval tools, optimizing observing strategies, and interpreting upcoming observations. Ground-based extremely large telescopes like ELT, GMT, and TMT; and future space-based mission concepts like Origins, HabEx, and LUVOIR are designed to have the capability of characterizing a variety of potentially habitable worlds. Some of these telescopes will use high precision radial velocity techniques to obtain the required high-resolution spectra ($R\approx100,000$) needed to characterize potentially habitable exoplanets. Here we present a database of high-resolution (0.01 cm$^{-1}$) reflection and emission spectra for simulated exoplanets with a wide range of surfaces, receiving similar irradiation as Earth around 12 different host stars from F0 to K7. Depending on surface type and host star, we show differences in spectral feature strength as well as overall reflectance, emission, and star to planet contrast ratio of terrestrial planets in the Habitable zone of their host stars. Accounting for the wavelength-dependent interaction of the stellar flux and the surface will help identify the best targets for upcoming spectral observations in the visible and infrared. All of our spectra and model profiles are available online.


title: Anisotropic Diffusion and Traveling Waves of Toxic Proteins in Neurodegenerative Diseases

abstract: Neurodegenerative diseases are closely associated with the amplification and invasion of toxic proteins. In particular Alzheimer's disease is characterized by the systematic progression of amyloid-$\beta$ and $\tau$-proteins in the brain. These two protein families are coupled and it is believed that their joint presence greatly enhances the resulting damage. Here, we examine a class of coupled chemical kinetics models of healthy and toxic proteins in two spatial dimensions. The anisotropic diffusion expected to take place within the brain along axonal pathways is factored in the models and produces a filamentary, predominantly one-dimensional transmission. Nevertheless, the potential of the anisotropic models towards generating interactions taking advantage of the two-dimensional landscape is showcased. Finally, a reduction of the models into a simpler family of generalized Fisher-Kolmogorov-Petrovskii-Piskunov (FKPP) type systems is examined. It is seen that the latter captures well the qualitative propagation features, although it may somewhat underestimate the concentrations of the toxic proteins.


title: Piecewise Linear Regression via a Difference of Convex Functions

abstract: We present a new piecewise linear regression methodology that utilizes fitting a difference of convex functions (DC functions) to the data. These are functions $f$ that may be represented as the difference $\phi_1 - \phi_2$ for a choice of convex functions $\phi_1, \phi_2$. The method proceeds by estimating piecewise-liner convex functions, in a manner similar to max-affine regression, whose difference approximates the data. The choice of the function is regularised by a new seminorm over the class of DC functions that controls the $\ell_\infty$ Lipschitz constant of the estimate. The resulting methodology can be efficiently implemented via Quadratic programming even in high dimensions, and is shown to have close to minimax statistical risk. We empirically validate the method, showing it to be practically implementable, and to have comparable performance to existing regression/classification methods on real-world datasets.


title: Participation is not a Design Fix for Machine Learning

abstract: This paper critically examines existing modes of participation in design practice and machine learning. Cautioning against 'participation-washing', it suggests that the ML community must become attuned to possibly exploitative and extractive forms of community involvement and shift away from the prerogatives of context-independent scalability.


title: Contextual-Relation Consistent Domain Adaptation for Semantic Segmentation

abstract: Recent advances in unsupervised domain adaptation for semantic segmentation have shown great potentials to relieve the demand of expensive per-pixel annotations. However, most existing works address the domain discrepancy by aligning the data distributions of two domains at a global image level whereas the local consistencies are largely neglected. This paper presents an innovative local contextual-relation consistent domain adaptation (CrCDA) technique that aims to achieve local-level consistencies during the global-level alignment. The idea is to take a closer look at region-wise feature representations and align them for local-level consistencies. Specifically, CrCDA learns and enforces the prototypical local contextual-relations explicitly in the feature space of a labelled source domain while transferring them to an unlabelled target domain via backpropagation-based adversarial learning. An adaptive entropy max-min adversarial learning scheme is designed to optimally align these hundreds of local contextual-relations across domain without requiring discriminator or extra computation overhead. The proposed CrCDA has been evaluated extensively over two challenging domain adaptive segmentation tasks (e.g., GTA5 to Cityscapes and SYNTHIA to Cityscapes), and experiments demonstrate its superior segmentation performance as compared with state-of-the-art methods.


title: Machine learning as a flaring storm warning machine: Was a warning machine for the September 2017 solar flaring storm possible?

abstract: Machine learning is nowadays the methodology of choice for flare forecasting and supervised techniques, in both their traditional and deep versions, are becoming the most frequently used ones for prediction in this area of space weather. Yet, machine learning has not been able so far to realize an operating warning system for flaring storms and the scientific literature of the last decade suggests that its performances in the prediction of intense solar flares are not optimal. The main difficulties related to forecasting solar flaring storms are probably two. First, most methods are conceived to provide probabilistic predictions and not to send binary yes/no indications on the consecutive occurrence of flares along an extended time range. Second, flaring storms are typically characterized by the explosion of high energy events, which are seldom recorded in the databases of space missions; as a consequence, supervised methods are trained on very imbalanced historical sets, which makes them particularly ineffective for the forecasting of intense flares. Yet, in this study we show that supervised machine learning could be utilized in a way to send timely warnings about the most violent and most unexpected flaring event of the last decade, and even to predict with some accuracy the energy budget daily released by magnetic reconnection during the whole time course of the storm. Further, we show that the combination of sparsity-enhancing machine learning and feature ranking could allow the identification of the prominent role that energy played as an Active Region property in the forecasting process.


title: The influence of sponsors on organizational structure of free software communities

abstract: Initially, free software communities are characterized by selfmanagement, however, they were also influenced by public and private organizations that identified potential gains in the use of the geographically distributed production model. In this context, this research aims to answer the following questions: Do sponsors influence the organizational structures of free software communities by promoting differences between sponsored and non-sponsored communities? What strategies are adopted by the sponsor to influence the organizational structure of free software communities? Two constructs are central to the study: organizational structure and sponsorship. For this research, we adopted case study methodology and three free software communities were studied. In the analysis of the results it was evidenced that sponsors influence decision making, definition of community key roles, and a formalization of norms. In turn, nonsponsored communities were characterized by the centralization and informality of the norms. We conclude that differences were identified in the organizational structure of sponsored and nonsponsored free software communities, and this differentiation was influenced by sponsors. In addition, it was possible to describe strategies and mechanisms used by sponsors to influence the community organizational structure.


title: Compact Oblivious Routing in Weighted Graphs

abstract: The space-requirement for routing-tables is an important characteristic of routing schemes. For the cost-measure of minimizing the total network load there exist a variety of results that show tradeoffs between stretch and required size for the routing tables. This paper designs compact routing schemes for the cost-measure congestion, where the goal is to minimize the maximum relative load of a link in the network (the relative load of a link is its traffic divided by its bandwidth). We show that for arbitrary undirected graphs we can obtain oblivious routing strategies with competitive ratio $\tilde{\mathcal{O}}(1)$ that have header length $\tilde{\mathcal{O}}(1)$, label size $\tilde{\mathcal{O}}(1)$, and require routing-tables of size $\tilde{\mathcal{O}}(\operatorname{deg}(v))$ at each vertex $v$ in the graph. This improves a result of R\"acke and Schmid who proved a similar result in unweighted graphs.


title: Depth-Adaptive Neural Networks from the Optimal Control viewpoint

abstract: In recent years, deep learning has been connected with optimal control as a way to define a notion of a continuous underlying learning problem. In this view, neural networks can be interpreted as a discretization of a parametric Ordinary Differential Equation which, in the limit, defines a continuous-depth neural network. The learning task then consists in finding the best ODE parameters for the problem under consideration, and their number increases with the accuracy of the time discretization. Although important steps have been taken to realize the advantages of such continuous formulations, most current learning techniques fix a discretization (i.e. the number of layers is fixed). In this work, we propose an iterative adaptive algorithm where we progressively refine the time discretization (i.e. we increase the number of layers). Provided that certain tolerances are met across the iterations, we prove that the strategy converges to the underlying continuous problem. One salient advantage of such a shallow-to-deep approach is that it helps to benefit in practice from the higher approximation properties of deep networks by mitigating over-parametrization issues. The performance of the approach is illustrated in several numerical examples.


title: Bers Slices in Families of Univalent Maps

abstract: We construct embeddings of Bers slices of ideal polygon reflection groups into the classical family of univalent functions $\Sigma$. This embedding is such that the conformal mating of the reflection group with the anti-holomorphic polynomial $z\mapsto\overline{z}^d$ is the Schwarz reflection map arising from the corresponding map in $\Sigma$. We characterize the image of this embedding in $\Sigma$ as a family of univalent rational maps. Moreover, we show that the limit set of every Kleinian reflection group in the closure of the Bers slice is naturally homeomorphic to the Julia set of an anti-holomorphic polynomial.


title: An infinite-dimensional 2-generated primitive axial algebra of Monster type

abstract: Rehren proved that a primitive 2-generated axial algebra of Monster type $(\alpha,\beta)$ has dimension at most eight if $\alpha\notin\{2\beta,4\beta\}$. In this note we construct an infinite-dimensional 2-generated primitive axial algebra of Monster type $(2,\frac{1}{2})$ over an arbitrary field $F$ with $char(F)\neq 2,3$. This shows that the second special case, $\alpha=4\beta$, is a true exception to Rehren's bound.


title: A stochastic calculus approach to the oracle separation of BQP and PH

abstract: After presentations of Raz and Tal's oracle separation of BQP and PH result, several people (e.g. Ryan O'Donnell, James Lee, Avishay Tal) suggested that the proof may be simplified by stochastic calculus. In this short note, we describe such a simplification.


title: Extending Mixture of Experts Model to Investigate Heterogeneity of Trajectories: When, Where and How to Add Which Covariates

abstract: Researchers are usually interested in examining the impact of covariates when separating heterogeneous samples into latent classes that are more homogeneous. The majority of theoretical and empirical studies with such aims have focused on identifying covariates as predictors of class membership in the structural equation modeling framework. In other words, the covariates only indirectly affect the sample heterogeneity. However, the covariates' influence on between-individual differences can also be direct. This article presents a mixture model that investigates covariates to explain within-cluster and between-cluster heterogeneity simultaneously, known as a mixture-of-experts (MoE) model. This study aims to extend the MoE framework to investigate heterogeneity in nonlinear trajectories: to identify latent classes, covariates as predictors to clusters, and covariates that explain within-cluster differences in change patterns over time. Our simulation studies demonstrate that the proposed model generally estimates the parameters unbiasedly, precisely and exhibits appropriate empirical coverage for a nominal 95% confidence interval. This study also proposes implementing structural equation model forests to shrink the covariate space of the proposed mixture model. We illustrate how to select covariates and construct the proposed model with longitudinal mathematics achievement data. Additionally, we demonstrate that the proposed mixture model can be further extended in the structural equation modeling framework by allowing the covariates that have direct effects to be time-varying.


title: Estimation of Ground Contacts from Human Gait by a Wearable Inertial Measurement Unit using machine learning

abstract: Robotics system for rehabilitation of movement disorders and motion assistance are gaining increased intention. In this scenario estimation of ground contact is an active area of research in robotics and healthcare. This article addresses the estimation and classification of right and left foot during the healthy human gait based on the IMU sensor data of chest and lower back. For this purpose we have collected an IMU data of 48 subjects by using two smartphones at chest and lower back of the human body and one smart watch at right ankle of the body. To show the robustness of our approach data was collected at six different surfaces (road tiles carpet grass concrete and soil). The recorded data of lower back and chest sensor was segmented into single steps on the basis of right ankle sensor data, then we computed a total of 408 features from time frequency and wavelet domain of each segmented step. For classification task we have trained two machine learning classifiers SVM and RF with 10 fold cross validation method. We performed classification experiments at individual surfaces, hard surfaces, soft surfaces and all surfaces, highest accuracy was achieved at individual surfaces with accuracy index of 98.88%. Furthermore, classification rate at hard soft and all surface are 95.60%, 94.38% and 95.05% respectively. The results shows that estimation of ground contact form normal human walk at different surfaces can be performed with high accuracy using 6D data of angular velocities and accelerations from chest and lower back location of the body.


title: Measurement of the $CP$-violating phase $\phi_\mathrm{s}$ in the B$^0_\mathrm{s}$ $\to$ J$/\psi\, \phi$(1020) $\to$ $\mu^+\mu^-$K$^+$K$^-$ channel in proton-proton collisions at $\sqrt{s} =$ 13 TeV

abstract: The $CP$-violating weak phase $\phi_\mathrm{s}$ and the decay width difference $\Delta\Gamma_\mathrm{s}$ between the light and heavy B$^0_\mathrm{s}$ mass eigenstates are measured with the CMS detector at the LHC in a sample of 48 500 reconstructed B$^0_\mathrm{s}$ $\to$ J$/\psi\, \phi$(1020) $\to$ $\mu^+\mu^-$K$^+$K$^-$ events. The measurement is based on a data sample corresponding to an integrated luminosity of 96.4 fb$^{-1}$, collected in proton-proton collisions at $\sqrt{s} =$ 13 TeV in 2017-2018. To extract the values of $\phi_\mathrm{s}$ and $\Delta\Gamma_\mathrm{s}$, a time-dependent and flavor-tagged angular analysis of the $\mu^+\mu^-$K$^+$K$^-$ final state is performed. The analysis employs a dedicated tagging trigger and a novel opposite-side muon flavor tagger based on machine learning techniques. The measurement yields $\phi_\mathrm{s} = -$11 $\pm$ 50 (stat) $\pm$ 10 (syst) mrad and $\Delta\Gamma_\mathrm{s} =$ 0.114 $\pm$ 0.014 (stat) $\pm$ 0.007 (syst) ps$^{-1}$, in agreement with the standard model predictions. When combined with the previous CMS measurement at $\sqrt{s} =$ 8 TeV, the following values are obtained: $\phi_\mathrm{s} = -$21 $\pm$ 44 (stat) $\pm$ 10 (syst) mrad, $\Delta\Gamma_\mathrm{s} =$ 0.1032 $\pm$ 0.0095 (stat) $\pm$ 0.0048 (syst) ps$^{-1}$, a significant improvement over the 8 TeV result.


title: Forecasting with Bayesian Grouped Random Effects in Panel Data

abstract: In this paper, we estimate and leverage latent constant group structure to generate the point, set, and density forecasts for short dynamic panel data. We implement a nonparametric Bayesian approach to simultaneously identify coefficients and group membership in the random effects which are heterogeneous across groups but fixed within a group. This method allows us to flexibly incorporate subjective prior knowledge on the group structure that potentially improves the predictive accuracy. In Monte Carlo experiments, we demonstrate that our Bayesian grouped random effects (BGRE) estimators produce accurate estimates and score predictive gains over standard panel data estimators. With a data-driven group structure, the BGRE estimators exhibit comparable accuracy of clustering with the Kmeans algorithm and outperform a two-step Bayesian grouped estimator whose group structure relies on Kmeans. In the empirical analysis, we apply our method to forecast the investment rate across a broad range of firms and illustrate that the estimated latent group structure improves forecasts relative to standard panel data estimators.


title: Modeling Dark Matter Halos with Nonlinear Field Theories

abstract: In the present work, we adopt a nonlinear scalar field theory coupled to the gravity sector to model galactic dark matter. We found analytical solutions for the scalar field coupled to gravity in the Newtonian limit, assuming an isotropic spacetime and a field potential, with a position dependent form of the superpotential, which entails the nonlinear dynamics of the model with self-interactions. The model introduces a position dependent enhancement of the self-interaction of the scalar fields towards the galaxy center, and while going towards the galaxy border the interaction tends to vanish building a non self-interacting DM scenario. The developed approach is able to provide a reasonable analytical description of the rotation curves in both dwarf and low surface brightness late-type galaxies, with parameters associated with the dynamics of the scalar field.


title: Matrix riccati equation solution of the 1d radiative transfer equation

abstract: In recent years, the first author has developed three successful numerical methods to solve the 1D radiative transport equation yielding highly precise benchmarks. The second author has shown a keen interest in novel solution methodologies and an ability for their implementation. Here, we combine talents to generate yet another high precision solution, the Matrix Riccati Equation Method (MREM). MREM features the solution to two of the four matrix Riccati ODEs that arise from the interaction principle of particle transport. Through interaction coefficients, the interaction principle describes how particles reflect from- and transmit through- a single slab. On combination with Taylor series and doubling, a high quality numerical benchmark, to nearly seven places, is established.


title: DepthNet: Real-Time LiDAR Point Cloud Depth Completion for Autonomous Vehicles

abstract: Autonomous vehicles rely heavily on sensors such as camera and LiDAR, which provide real-time information about their surroundings for the tasks of perception, planning and control. Typically a LiDAR can only provide sparse point cloud owing to a limited number of scanning lines. By employing depth completion, a dense depth map can be generated by assigning each camera pixel a corresponding depth value. However, the existing depth completion convolutional neural networks are very complex that requires high-end GPUs for processing, and thus they are not applicable to real-time autonomous driving. In this paper, a light-weight network is proposed for the task of LiDAR point cloud depth completion. With an astonishing 96.2% reduction in the number of parameters, it still achieves comparable performance (9.3% better in MAE but 3.9% worse in RMSE) to the state-of-the-art network. For real-time embedded platforms, depthwise separable technique is applied to both convolution and deconvolution operations and the number of parameters decreases further by a factor of 7.3, with only a small percentage increase in RMSE and MAE performance. Moreover, a system-on-chip architecture for depth completion is developed on a PYNQ-based FPGA platform that achieves real-time processing for HDL-64E LiDAR at the speed 11.1 frame per second.


title: Pretrained Generalized Autoregressive Model with Adaptive Probabilistic Label Clusters for Extreme Multi-label Text Classification

abstract: Extreme multi-label text classification (XMTC) is a task for tagging a given text with the most relevant labels from an extremely large label set. We propose a novel deep learning method called APLC-XLNet. Our approach fine-tunes the recently released generalized autoregressive pretrained model (XLNet) to learn a dense representation for the input text. We propose Adaptive Probabilistic Label Clusters (APLC) to approximate the cross entropy loss by exploiting the unbalanced label distribution to form clusters that explicitly reduce the computational time. Our experiments, carried out on five benchmark datasets, show that our approach has achieved new state-of-the-art results on four benchmark datasets. Our source code is available publicly at https://github.com/huiyegit/APLC_XLNet.


title: Interpolation results for pathwise Hamilton-Jacobi equations

abstract: We study the interplay between the regularity of paths and Hamiltonians in the theory of pathwise Hamilton-Jacobi equations with the use of interpolation methods. The regularity of the paths is measured with respect to Sobolev, Besov, H\"older, and variation norms, and criteria for the Hamiltonians are presented in terms of both regularity and structure. We also explore various properties of functions that are representable as the difference of convex functions, the largest space of Hamiltonians for which the equation is well-posed for all continuous paths. Finally, we discuss some open problems and conjectures.


title: GAN-based Hyperspectral Anomaly Detection

abstract: In this paper, we propose a generative adversarial network (GAN)-based hyperspectral anomaly detection algorithm. In the proposed algorithm, we train a GAN model to generate a synthetic background image which is close to the original background image as much as possible. By subtracting the synthetic image from the original one, we are able to remove the background from the hyperspectral image. Anomaly detection is performed by applying Reed-Xiaoli (RX) anomaly detector (AD) on the spectral difference image. In the experimental part, we compare our proposed method with the classical RX, Weighted-RX (WRX) and support vector data description (SVDD)-based anomaly detectors and deep autoencoder anomaly detection (DAEAD) method on synthetic and real hyperspectral images. The detection results show that our proposed algorithm outperforms the other methods in the benchmark.


title: GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis

abstract: While 2D generative adversarial networks have enabled high-resolution image synthesis, they largely lack an understanding of the 3D world and the image formation process. Thus, they do not provide precise control over camera viewpoint or object pose. To address this problem, several recent approaches leverage intermediate voxel-based representations in combination with differentiable rendering. However, existing methods either produce low image resolution or fall short in disentangling camera and scene properties, e.g., the object identity may vary with the viewpoint. In this paper, we propose a generative model for radiance fields which have recently proven successful for novel view synthesis of a single scene. In contrast to voxel-based representations, radiance fields are not confined to a coarse discretization of the 3D space, yet allow for disentangling camera and scene properties while degrading gracefully in the presence of reconstruction ambiguity. By introducing a multi-scale patch-based discriminator, we demonstrate synthesis of high-resolution images while training our model from unposed 2D images alone. We systematically analyze our approach on several challenging synthetic and real-world datasets. Our experiments reveal that radiance fields are a powerful representation for generative image synthesis, leading to 3D consistent models that render with high fidelity.


title: Pseudo-Rehearsal for Continual Learning with Normalizing Flows

abstract: Catastrophic forgetting (CF) happens whenever a neural network overwrites past knowledge while being trained on new tasks. Common techniques to handle CF include regularization of the weights (using, e.g., their importance on past tasks), and rehearsal strategies, where the network is constantly re-trained on past data. Generative models have also been applied for the latter, in order to have endless sources of data. In this paper, we propose a novel method that combines the strengths of regularization and generative-based rehearsal approaches. Our generative model consists of a normalizing flow (NF), a probabilistic and invertible neural network, trained on the internal embeddings of the network. By keeping a single NF conditioned on the task, we show that our memory overhead remains constant. In addition, exploiting the invertibility of the NF, we propose a simple approach to regularize the network's embeddings with respect to past tasks. We show that our method performs favorably with respect to state-of-the-art approaches in the literature, with bounded computational power and memory overheads.


title: Calibration of 122 SensL MicroFJ-60035 SiPMs and the reduction of optical crosstalk due to coupled light guides

abstract: The excellent production quality of recent generations of Silicon Photomultipliers (SiPMs) allows for operation without individual calibration of the breakdown voltage. Measurements of the crosstalk probability and the relative gain of 122 SiPMs of type SensL MicroFJ-60035-TSV are presented. Semi-conductor photo sensors have replaced photo multiplier tubes in numerous applications featuring single-photon resolution, insensitivity to magnetic fields, higher robustness and enhanced photo detection efficiency at lower operation voltage and lower costs. Light guides are used to increase the comparably small photo sensitive area of SiPMs. Their optical coupling changes the surface conditions of the sensor and influences the probability for crosstalk photons to leave the sensor without inducing secondary breakdowns. This study compares properties of sensors that are optically coupled to light guides with bare sensors, operated at nominal bias voltage. It demonstrates, that the optical coupling to a light guide significantly reduces the crosstalk probability of the measured sensors.


title: Overlapping Spaces for Compact Graph Representations

abstract: Various non-trivial spaces are becoming popular for embedding structured data such as graphs, texts, or images. Following spherical and hyperbolic spaces, more general product spaces have been proposed. However, searching for the best configuration of product space is a resource-intensive procedure, which reduces the practical applicability of the idea. We generalize the concept of product space and introduce an overlapping space that does not have the configuration search problem. The main idea is to allow subsets of coordinates to be shared between spaces of different types (Euclidean, hyperbolic, spherical). As a result, parameter optimization automatically learns the optimal configuration. Additionally, overlapping spaces allow for more compact representations since their geometry is more complex. Our experiments confirm that overlapping spaces outperform the competitors in graph embedding tasks. Here, we consider both distortion setup, where the aim is to preserve distances, and ranking setup, where the relative order should be preserved. The proposed method effectively solves the problem and outperforms the competitors in both settings. We also perform an empirical analysis in a realistic information retrieval task, where we compare all spaces by incorporating them into DSSM. In this case, the proposed overlapping space consistently achieves nearly optimal results without any configuration tuning. This allows for reducing training time, which can be significant in large-scale applications.


title: The Hodge realization functor on the derived category of relative motives

abstract: We give, for a complex algebraic variety $S$, a Hodge realization functor $\mathcal F_S^{Hdg}$ from the derived category of constructible motives $DA_c(S)$ to the derived category $D(MHM(S))$ of algebraic mixed Hodge modules over $S$. Moreover, for $f:T\to S$ a morphism of complex quasi-projective algebraic varieties, $\mathcal F_{-}^{Hdg}$ commutes with the four operation $f^*$,$f_*$,$f_!$,$f^!$ on $DA_c(-)$ and $D(MHM(-))$, making the Hodge realization functor a morphism of 2-functor wich for a given $S$ sends $DA_c(S)$ to $D(MHM(S)$, moreover $\mathcal F_S^{Hdg}$ commutes with tensor product. We also give an algebraic and analytic Gauss-Manin realization functor from which we obtain a base change theorem for algebraic De Rham cohomology and for all smooth morphisms a realtive version of the comparaison theorem of Grothendieck between the algebaric De Rham cohomology and the analytic De Rham cohomology.


title: Anatomical Data Augmentation via Fluid-based Image Registration

abstract: We introduce a fluid-based image augmentation method for medical image analysis. In contrast to existing methods, our framework generates anatomically meaningful images via interpolation from the geodesic subspace underlying given samples. Our approach consists of three steps: 1) given a source image and a set of target images, we construct a geodesic subspace using the Large Deformation Diffeomorphic Metric Mapping (LDDMM) model; 2) we sample transformations from the resulting geodesic subspace; 3) we obtain deformed images and segmentations via interpolation. Experiments on brain (LPBA) and knee (OAI) data illustrate the performance of our approach on two tasks: 1) data augmentation during training and testing for image segmentation; 2) one-shot learning for single atlas image segmentation. We demonstrate that our approach generates anatomically meaningful data and improves performance on these tasks over competing approaches. Code is available at https://github.com/uncbiag/easyreg.


title: Novel min-max reformulations of Linear Inverse Problems

abstract: In this article, we dwell into the class of so-called ill-posed Linear Inverse Problems (LIP) which simply refers to the task of recovering the entire signal from its relatively few random linear measurements. Such problems arise in a variety of settings with applications ranging from medical image processing, recommender systems, etc. We propose a slightly generalized version of the error constrained linear inverse problem and obtain a novel and equivalent convex-concave min-max reformulation by providing an exposition to its convex geometry. Saddle points of the min-max problem are completely characterized in terms of a solution to the LIP, and vice versa. Applying simple saddle point seeking ascend-descent type algorithms to solve the min-max problems provides novel and simple algorithms to find a solution to the LIP. Moreover, the reformulation of an LIP as the min-max problem provided in this article is crucial in developing methods to solve the dictionary learning problem with almost sure recovery constraints.


title: Momentum Accelerates Evolutionary Dynamics

abstract: We combine momentum from machine learning with evolutionary dynamics, where momentum can be viewed as a simple mechanism of intergenerational memory. Using information divergences as Lyapunov functions, we show that momentum accelerates the convergence of evolutionary dynamics including the replicator equation and Euclidean gradient descent on populations. When evolutionarily stable states are present, these methods prove convergence for small learning rates or small momentum, and yield an analytic determination of the relative decrease in time to converge that agrees well with computations. The main results apply even when the evolutionary dynamic is not a gradient flow. We also show that momentum can alter the convergence properties of these dynamics, for example by breaking the cycling associated to the rock-paper-scissors landscape, leading to either convergence to the ordinarily non-absorbing equilibrium, or divergence, depending on the value and mechanism of momentum.


title: On the convergence properties of Durrmeyer-Sampling Type Operators in Orlicz spaces

abstract: Here we provide a unifying treatment of the convergence of a general form of sampling type operators, given by the so-called Durrmeyer sampling type series. In particular we provide a pointwise and uniform convergence theorem on $\mathbb{R}$, and in this context we also furnish a quantitative estimate for the order of approximation, using the modulus of continuity of the function to be approximated. Then we obtain a modular convergence theorem in the general setting of Orlicz spaces $L^\varphi(\mathbb{R})$. From the latter result, the convergence in $L^p(\mathbb{R})$-space, $L^\alpha\log^\beta L$, and the exponential spaces follow as particular cases. Finally, applications and examples with graphical representations are given for several sampling series with special kernels.


title: The Berkani's property and a note on some recent results

abstract: In this paper, we continue the study of property $(UW_{\Pi})$ introduced in \cite{berkani2}, in connection with other Weyl type theorems. Moreover, we give counterexamples to show that some recent results related to this property, which are announced and proved by P. Aiena and M. Kachad in \cite{aiena1} are false. Furthermore, we specify the mistakes committed in each of them and we give the correct versions. We also give a global note on the paper \cite{jayanthi}.


title: Exploratory Analysis of COVID-19 Related Tweets in North America to Inform Public Health Institutes

abstract: Social media is a rich source where we can learn about people's reactions to social issues. As COVID-19 has significantly impacted on people's lives, it is essential to capture how people react to public health interventions and understand their concerns. In this paper, we aim to investigate people's reactions and concerns about COVID-19 in North America, especially focusing on Canada. We analyze COVID-19 related tweets using topic modeling and aspect-based sentiment analysis, and interpret the results with public health experts. We compare timeline of topics discussed with timing of implementation of public health interventions for COVID-19. We also examine people's sentiment about COVID-19 related issues. We discuss how the results can be helpful for public health agencies when designing a policy for new interventions. Our work shows how Natural Language Processing (NLP) techniques could be applied to public health questions with domain expert involvement.


title: Topological versus spectral properties of random geometric graphs

abstract: In this work we perform a detailed statistical analysis of topological and spectral properties of random geometric graphs (RGGs); a graph model used to study the structure and dynamics of complex systems embedded in a two dimensional space. RGGs, $G(n,\ell)$, consist of $n$ vertices uniformly and independently distributed on the unit square, where two vertices are connected by an edge if their Euclidian distance is less or equal than the connection radius $\ell \in [0,\sqrt{2}]$. To evaluate the topological properties of RGGs we chose two well-known topological indices, the Randi\'c index $R(G)$ and the harmonic index $H(G)$. While we characterize the spectral and eigenvector properties of the corresponding randomly-weighted adjacency matrices by the use of random matrix theory measures: the ratio between consecutive eigenvalue spacings, the inverse participation ratios and the information or Shannon entropies $S(G)$. First, we review the scaling properties of the averaged measures, topological and spectral, on RGGs. Then we show that: (i) the averaged--scaled indices, $\left\langle R(G) \right\rangle$ and $\left\langle H(G) \right\rangle$, are highly correlated with the average number of non-isolated vertices $\left\langle V_\times(G) \right\rangle$; and (ii) surprisingly, the averaged--scaled Shannon entropy $\left\langle S(G) \right\rangle$ is also highly correlated with $\left\langle V_\times(G) \right\rangle$. Therefore, we suggest that very reliable predictions of eigenvector properties of RGGs could be made by computing topological indices.


title: Self-Challenging Improves Cross-Domain Generalization

abstract: Convolutional Neural Networks (CNN) conduct image classification by activating dominant features that correlated with labels. When the training and testing data are under similar distributions, their dominant features are similar, which usually facilitates decent performance on the testing data. The performance is nonetheless unmet when tested on samples from different distributions, leading to the challenges in cross-domain image classification. We introduce a simple training heuristic, Representation Self-Challenging (RSC), that significantly improves the generalization of CNN to the out-of-domain data. RSC iteratively challenges (discards) the dominant features activated on the training data, and forces the network to activate remaining features that correlates with labels. This process appears to activate feature representations applicable to out-of-domain data without prior knowledge of new domain and without learning extra network parameters. We present theoretical properties and conditions of RSC for improving cross-domain generalization. The experiments endorse the simple, effective and architecture-agnostic nature of our RSC method.


title: Handling highly correlated genes in prediction analysis of genomic studies

abstract: Background: Selecting feature genes to predict phenotypes is one of the typical tasks in analyzing genomics data. Though many general-purpose algorithms were developed for prediction, dealing with highly correlated genes in the prediction model is still not well addressed. High correlation among genes introduces technical problems, such as multi-collinearity issues, leading to unreliable prediction models. Furthermore, when a causal gene (whose variants have an actual biological effect on a phenotype) is highly correlated with other genes, most algorithms select the feature gene from the correlated group in a purely data-driven manner. Since the correlation structure among genes could change substantially when condition changes, the prediction model based on not correctly selected feature genes is unreliable. Therefore, we aim to keep the causal biological signal in the prediction process and build a more robust prediction model. Method: We propose a grouping algorithm, which treats highly correlated genes as a group and uses their common pattern to represent the group's biological signal in feature selection. Our novel grouping algorithm can be integrated into existing prediction algorithms to enhance their prediction performance. Our proposed grouping method has two advantages. First, using the gene group's common patterns makes the prediction more robust and reliable under condition change. Second, it reports whole correlated gene groups as discovered biomarkers for prediction tasks, allowing researchers to conduct follow-up studies to identify causal genes within the identified groups. Result: Using real benchmark scRNA-seq datasets with simulated cell phenotypes, we demonstrate our novel method significantly outperforms standard models in both (1) prediction of cell phenotypes and (2) feature gene selection.


title: Everyone's Universe: Teaching Astronomy in Community Colleges

abstract: Despite the negative stereotypes still overshadowing community colleges, scores of freshmen nationwide are deliberately beginning their college careers at these institutions, and the numbers are increasing more than twice as fast as those of four-year schools. Approximately 300,000 of these students take introductory astronomy each year as the last formal exposure to science most of them will ever have, and at least one-third of these students do so at a community or two-year college. The importance of investing in and devoting resources and training to serve this population - everyone, demographically speaking - cannot be overstated. Yet the overwhelming majority of those who do serve this population are lacking in both areas. The community colleges' heavy emphasis on teaching and student success creates both challenges and opportunities that educators must meet head-on using a variety of methods and innovative strategies, teamwork and faculty support systems, and clever workarounds. Here, we introduce both the student and faculty populations, examine some characteristics of both populations, and offer some advice for those looking to teach introductory astronomy at a community college.


title: Using Capsule Neural Network to predict Tuberculosis in lens-free microscopic images

abstract: Tuberculosis, caused by a bacteria called Mycobacterium tuberculosis, is one of the most serious public health problems worldwide. This work seeks to facilitate and automate the prediction of tuberculosis by the MODS method and using lens-free microscopy, which is easy to use by untrained personnel. We employ the CapsNet architecture in our collected dataset and show that it has a better accuracy than traditional CNN architectures.


title: Evaluating the Calibration of SN Ia Anchor Datasets with a Bayesian Hierarchical Model

abstract: Inter-survey calibration remains an important systematic uncertainty in cosmological studies using type Ia supernova (SNe Ia). Ideally, each survey would measure its system throughputs, for instance with bandpass measurements combined with observations of well-characterized spectrophotometric standard stars; however, many important nearby-SN surveys have not done this. We recalibrate these surveys by tying their tertiary survey stars to Pan-STARRS1 g, r, and i, and SDSS/CSP u. This improves upon previous recalibration efforts by taking the spatially variable zeropoints of each telescope/camera into account, and applying improved color transformations in the surveys' natural instrumental photometric systems. Our analysis uses a global hierarchical model of the data which produces a covariance matrix of magnitude offsets and bandpass shifts, quantifying and reducing the systematic uncertainties in the calibration. We call our method CROSS-CALIBration with a Uniform Reanalysis (X-CALIBUR). This approach gains not only from a sophisticated analysis, but also from simply tying our calibration to more color calibrators, rather than just the one color calibrator (BD+17 4708) as many previous efforts have done. The results presented here have the potential to help understand and improve calibration uncertainties upcoming SN Ia cosmological analyses.

categories: astro-ph.SR astro-ph.CO astro-ph.GA astro-ph.IM


title: Decomposing Linear Representations of Finite Groups

abstract: We develop a package using the computer algebra system GAP for computing the decomposition of a representation $\rho$ of a finite group $G$ over $\mathbb{C}$ into irreducibles, as well as the corresponding decomposition of the centraliser ring of $\rho(G)$. Currently, the only open-source programs for decomposing representations are for non-zero characteristic fields. While methods for characteristic zero are known, there are no open-source computer programs that implement these methods, nor are details on how to achieve good performance of such an implementation published. We aim to record such details and demonstrate an application of our program in reducing the size of semidefinite programs.


title: An Automated and Robust Image Watermarking Scheme Based on Deep Neural Networks

abstract: Digital image watermarking is the process of embedding and extracting a watermark covertly on a cover-image. To dynamically adapt image watermarking algorithms, deep learning-based image watermarking schemes have attracted increased attention during recent years. However, existing deep learning-based watermarking methods neither fully apply the fitting ability to learn and automate the embedding and extracting algorithms, nor achieve the properties of robustness and blindness simultaneously. In this paper, a robust and blind image watermarking scheme based on deep learning neural networks is proposed. To minimize the requirement of domain knowledge, the fitting ability of deep neural networks is exploited to learn and generalize an automated image watermarking algorithm. A deep learning architecture is specially designed for image watermarking tasks, which will be trained in an unsupervised manner to avoid human intervention and annotation. To facilitate flexible applications, the robustness of the proposed scheme is achieved without requiring any prior knowledge or adversarial examples of possible attacks. A challenging case of watermark extraction from phone camera-captured images demonstrates the robustness and practicality of the proposal. The experiments, evaluation, and application cases confirm the superiority of the proposed scheme.


title: CORD19STS: COVID-19 Semantic Textual Similarity Dataset

abstract: In order to combat the COVID-19 pandemic, society can benefit from various natural language processing applications, such as dialog medical diagnosis systems and information retrieval engines calibrated specifically for COVID-19. These applications rely on the ability to measure semantic textual similarity (STS), making STS a fundamental task that can benefit several downstream applications. However, existing STS datasets and models fail to translate their performance to a domain-specific environment such as COVID-19. To overcome this gap, we introduce CORD19STS dataset which includes 13,710 annotated sentence pairs collected from COVID-19 open research dataset (CORD-19) challenge. To be specific, we generated one million sentence pairs using different sampling strategies. We then used a finetuned BERT-like language model, which we call Sen-SCI-CORD19-BERT, to calculate the similarity scores between sentence pairs to provide a balanced dataset with respect to the different semantic similarity levels, which gives us a total of 32K sentence pairs. Each sentence pair was annotated by five Amazon Mechanical Turk (AMT) crowd workers, where the labels represent different semantic similarity levels between the sentence pairs (i.e. related, somewhat-related, and not-related). After employing a rigorous qualification tasks to verify collected annotations, our final CORD19STS dataset includes 13,710 sentence pairs.


title: Compressible Latent-Space Invertible Networks for Generative Model-Constrained Image Reconstruction

abstract: There remains an important need for the development of image reconstruction methods that can produce diagnostically useful images from undersampled measurements. In magnetic resonance imaging (MRI), for example, such methods can facilitate reductions in data-acquisition times. Deep learning-based methods hold potential for learning object priors or constraints that can serve to mitigate the effects of data-incompleteness on image reconstruction. One line of emerging research involves formulating an optimization-based reconstruction method in the latent space of a generative deep neural network. However, when generative adversarial networks (GANs) are employed, such methods can result in image reconstruction errors if the sought-after solution does not reside within the range of the GAN. To circumvent this problem, in this work, a framework for reconstructing images from incomplete measurements is proposed that is formulated in the latent space of invertible neural network-based generative models. A novel regularization strategy is introduced that takes advantage of the multiscale architecture of certain invertible neural networks, which can result in improved reconstruction performance over classical methods in terms of traditional metrics. The proposed method is investigated for reconstructing images from undersampled MRI data. The method is shown to achieve comparable performance to a state-of-the-art generative model-based reconstruction method while benefiting from a deterministic reconstruction procedure and easier control over regularization parameters.


title: Relativistic nuclear collisions: Establishing a non-critical baseline for fluctuation measurements

abstract: We study the influence of global baryon number conservation on the non-critical baseline of net baryon cumulants in heavy-ion collisions in a given acceptance, accounting for the asymmetry between the mean-numbers of baryons and antibaryons. We derive the probability distribution of net baryon number in a restricted phase space from the canonical partition function that incorporates exact conservation of baryon number in the full system. Furthermore, we provide tools to compute cumulants of any order from the generating function of uncorrelated baryons constrained by exact baryon number conservation. The results are applied to quantify the non-critical baseline for cumulants of net proton number fluctuations obtained in heavy-ion collisions by the STAR collaboration at different RHIC energies and by the ALICE collaboration at the LHC. Furthermore, volume fluctuations are added by a Monte Carlo procedure based on the centrality dependence of charged particle production as measured experimentally. Compared to the predictions based on the hadron resonance gas model or Skellam distribution a clear suppression of fluctuations is observed due to exact baryon-number conservation. The suppression increases with the order of the cumulant and towards lower collision energies. Predictions for net proton cumulants up to the eight order in heavy-ion collisions are given for experimentally accessible collision energies.


title: Spectroscopic Evidence for Charge Order Melting via Quantum Fluctuations in a Cuprate

abstract: Copper-oxide high TC superconductors possess a number of exotic orders co-existing with or proximal to superconductivity, whose quantum fluctuations may account for the unusual behaviors of the normal state, even affecting superconductivity. Yet, spectroscopic evidence about such quantum fluctuations remains elusive. Here, we reveal spectroscopic fingerprints for such fluctuations associated with a charge order (CO) in nearly optimally-doped Bi2Sr2CaCu2O8+d, using resonant inelastic x-ray scattering (RIXS). In the superconducting state, while the quasi-elastic CO signal decreases with temperature, the interplay between CO fluctuations and bond-stretching phonons in the form of a Fano-like interference paradoxically increases, incompatible with expectations for competing orders. Invoking general principles, we argue that this behavior reflects the properties of a dissipative system near an order-disorder quantum critical point, where the dissipation varies with the opening of the pseudogap and superconducting gap at low temperatures, leading to the proliferation of quantum critical fluctuations which melt CO.


title: A substrateless, flexible, and water-resistant organic light-emitting diode

abstract: Despite widespread interest, ultrathin and highly flexible light-emitting devices that can be seamlessly integrated and used for flexible displays, wearables, and as bioimplants remain elusive. Organic light-emitting diodes (OLEDs) with $\mu$m-scale thickness and exceptional flexibility have been demonstrated but show insufficient stability in air and moist environments due to a lack of suitable encapsulation barriers. Here, we demonstrate an efficient and stable OLED with a total thickness of $\approx$12 $\mu$m that can be fully immersed in water or cell nutrient media for weeks without suffering substantial degradation. The active layers of the device are embedded between conformal barriers formed by alternating layers of parylene-C and metal oxides that are deposited through a low temperature chemical vapour process. These barriers also confer stability of the OLED to repeated bending and to extensive postprocessing, e.g. via reactive gas plasmas, organic solvents, and photolithography. This unprecedented robustness opens up a wide range of novel possibilities for ultrathin OLEDs.


title: Hybrid RF/VLC Systems: A Comprehensive Survey on Network Topologies, Performance Analyses, Applications, and Future Directions

abstract: Wireless communications refer to data transmissions in unguided propagation media through the use of wireless carriers such as radio frequency (RF) and visible light (VL) waves. The rising demand for high data rates, especially, in indoor scenarios, overloads conventional RF technologies. Therefore, technologies such as millimeter waves (mmWave) and cognitive radios have been adopted as possible solutions to overcome the spectrum scarcity and capacity limitations of the conventional RF systems. In parallel, visible light communication (VLC) has been proposed as an alternative solution, where a light source is used for both illumination and data transmission. In comparison to RF links, VLC links present a very high bandwidth that allows much higher data rates. VLC exhibits also immunity to interference from electromagnetic sources, has unlicensed channels, is a very low power consumption system, and has no health hazard. VLC is appealing for a wide range of applications including reliable communications with low latency such as vehicle safety communication. Despite the major advantages of VLC technology and a variety of its applications, its use has been hampered by its cons such as its dependence on a line of sight connectivity. Recently, hybrid RF/VLC systems were proposed to take advantage of the high capacity of VLC links and better connectivity of RF links. Thus, hybrid RF/VLC systems are envisioned as a key enabler to improve the user rates and mobility on one hand and to optimize the capacity, interference and power consumption of the overall network on the other hand. This paper seeks to provide a detailed survey of hybrid RF/VLC systems. This paper represents an overview of the current developments in the hybrid RF/VLC systems, their benefits and limitations for both newcomers and expert researchers.


title: Topics in Topology and Homotopy Theory

abstract: This book is an account of certain topics in general and algebraic topology. Instead of laying out a synopsis of each chapter, here is a sample of some of what is taken up: 1) Nilpotency and its role in homotopy theory. 2) Bousfield's theory of the localization of spaces and spectra. 3) Homotopy limits and colimits and their applications. 4) The James construction, symmetric products, and the Dold$-$Thom theorem. 5) Brown and Adams representability in the setting of triangulated categories 6) Operads and the May$-$Thomason theorem on the uniqueness of infinite loop space machines. 7) The plus construction and theorems A and B of Quillen. 8) Hopkins' global picture of stable homotopy theory. 9) Model categories, cofibration categories, and Waldhausen categories. 10) The Dugundji extension theorem and its consequences.


title: Non-Hermitian generalizations of extended Su-Schrieffer-Heeger models

abstract: Non-Hermitian generalizations of the Su-Schrieffer-Heeger (SSH) models with higher periods of the hopping coefficients, called the SSH3 and SSH4 models, are analyzed. The conventional construction of the winding number fails for the Hermitian SSH3 model, but the non-Hermitian generalization leads to a topological system due to a point gap on the complex plane. The non-Hermitian SSH3 model thus has a winding number and exhibits the non-Hermitian skin effect. Moreover, the SSH3 model has two types of localized states and a zero-energy state associated with special symmetries. The total Zak phase of the SSH3 model exhibits quantization, and its finite value indicates coexistence of the two types of localized states. Meanwhile, the SSH4 model resembles the SSH model, and its non-Hermitian generalization also exhibits the non-Hermitian skin effect. A careful analysis of the non-Hermitian SSH4 model with different boundary conditions shows the bulk-boundary correspondence is restored with the help of the generalized Brillouin zone or the real-space winding number. The physics of the non-Hermitian SSH3 and SSH4 models may be tested in cold-atom or other simulators.


title: Observation of phonon trapping in the continuum with topological charges

abstract: Phonon trapping has an immense impact in many areas of science and technology, from the antennas of interferometric gravitational wave detectors to chip-scale quantum micro- and nano-mechanical oscillators. It usually relies on the mechanical suspension--an approach, while isolating selected vibrational modes, leads to serious drawbacks for interrogation of the trapped phonons, including limited heat capacity and excess noises via measurements. To circumvent these constraints, we realize a new paradigm of phonon trapping using mechanical bound states in the continuum (BICs) with topological features and conducted an in-depth characterization of the mechanical losses both at room and cryogenic temperatures. Our findings of mechanical BICs combining the microwave frequency and macroscopic size unveil a unique platform for realizing mechanical oscillators in both classical and quantum regimes. The paradigm of mechanical BICs might lead to unprecedented sensing modalities for applications such as rare-event searches and the exploration of the foundations of quantum mechanics in unreached parameter spaces.


title: Online Regularization towards Always-Valid High-Dimensional Dynamic Pricing

abstract: Devising dynamic pricing policy with always valid online statistical learning procedure is an important and as yet unresolved problem. Most existing dynamic pricing policy, which focus on the faithfulness of adopted customer choice models, exhibit a limited capability for adapting the online uncertainty of learned statistical model during pricing process. In this paper, we propose a novel approach for designing dynamic pricing policy based regularized online statistical learning with theoretical guarantees. The new approach overcomes the challenge of continuous monitoring of online Lasso procedure and possesses several appealing properties. In particular, we make the decisive observation that the always-validity of pricing decisions builds and thrives on the online regularization scheme. Our proposed online regularization scheme equips the proposed optimistic online regularized maximum likelihood pricing (OORMLP) pricing policy with three major advantages: encode market noise knowledge into pricing process optimism; empower online statistical learning with always-validity over all decision points; envelop prediction error process with time-uniform non-asymptotic oracle inequalities. This type of non-asymptotic inference results allows us to design more sample-efficient and robust dynamic pricing algorithms in practice. In theory, the proposed OORMLP algorithm exploits the sparsity structure of high-dimensional models and secures a logarithmic regret in a decision horizon. These theoretical advances are made possible by proposing an optimistic online Lasso procedure that resolves dynamic pricing problems at the process level, based on a novel use of non-asymptotic martingale concentration. In experiments, we evaluate OORMLP in different synthetic and real pricing problem settings, and demonstrate that OORMLP advances the state-of-the-art methods.


title: Accelerated MRI with Un-trained Neural Networks

abstract: Convolutional Neural Networks (CNNs) are highly effective for image reconstruction problems. Typically, CNNs are trained on large amounts of training images. Recently, however, un-trained CNNs such as the Deep Image Prior and Deep Decoder have achieved excellent performance for image reconstruction problems such as denoising and inpainting, \emph{without using any training data}. Motivated by this development, we address the reconstruction problem arising in accelerated MRI with un-trained neural networks. We propose a highly optimized un-trained recovery approach based on a variation of the Deep Decoder and show that it significantly outperforms other un-trained methods, in particular sparsity-based classical compressed sensing methods and naive applications of un-trained neural networks. We also compare performance (both in terms of reconstruction accuracy and computational cost) in an ideal setup for trained methods, specifically on the fastMRI dataset, where the training and test data come from the same distribution. We find that our un-trained algorithm achieves similar performance to a baseline trained neural network, but a state-of-the-art trained network outperforms the un-trained one. Finally, we perform a comparison on a non-ideal setup where the train and test distributions are slightly different, and find that our un-trained method achieves similar performance to a state-of-the-art accelerated MRI reconstruction method.


title: A modified axiomatic foundation of the analytic hierarchy process

abstract: This paper reports a modified axiomatic foundation of the analytic hierarchy process (AHP), where the reciprocal property of paired comparisons is broken. The novel concept of reciprocal symmetry breaking is proposed to characterize the considered situation without reciprocal property. It is found that the uncertainty experienced by the decision maker can be naturally incorporated into the modified axioms. Some results are derived from the new axioms involving the new concept of approximate consistency and the method of eliciting priorities. The phenomenon of ranking reversal is revisited from a theoretical viewpoint under the modified axiomatic foundation. The situations without ranking reversal are addressed and called ranking equilibrium. The likelihood of ranking reversal is captured by introducing a possibility degree index based on the Kendall's coefficient of concordance. The modified axioms and the derived facts form a novel operational basis of the AHP choice model under some uncertainty. The observations reveal that a more flexible expression of decision information could be accepted as compared to the judgments with reciprocal property.


title: From $\mu_0$ to $e$: A Survey of Major Impacts for Electrical Measurements in Recent SI Revision

abstract: A milestone revision of the International System of Units (SI) was made at the 26th General Conference on Weights and Measures that four of the seven SI base units, i.e. kilogram, ampere, kelvin, and mole, are redefined by fundamental physical constants of nature. The SI base unit founding the electrical measurement activities, i.e. ampere, is defined by fixing the numerical value of the elementary charge to $e=1.602\,176\,634\times10^{-19}$C. For electrical measurement, several major adjustments, mostly positive, are involved in this SI revision. In this paper, the main impacts of the new SI for electrical measurement activities are surveyed under the new framework.


title: Understanding Echo Chambers in E-commerce Recommender Systems

abstract: Personalized recommendation benefits users in accessing contents of interests effectively. Current research on recommender systems mostly focuses on matching users with proper items based on user interests. However, significant efforts are missing to understand how the recommendations influence user preferences and behaviors, e.g., if and how recommendations result in \textit{echo chambers}. Extensive efforts have been made in examining the phenomenon in online media and social network systems. Meanwhile, there are growing concerns that recommender systems might lead to the self-reinforcing of user's interests due to narrowed exposure of items, which may be the potential cause of echo chamber. In this paper, we aim to analyze the echo chamber phenomenon in Alibaba Taobao -- one of the largest e-commerce platforms in the world. Echo chamber means the effect of user interests being reinforced through repeated exposure to similar contents. Based on the definition, we examine the presence of echo chamber in two steps. First, we explore whether user interests have been reinforced. Second, we check whether the reinforcement results from the exposure of similar contents. Our evaluations are enhanced with robust metrics, including cluster validity and statistical significance. Experiments are performed on extensive collections of real-world data consisting of user clicks, purchases, and browse logs from Alibaba Taobao. Evidence suggests the tendency of echo chamber in user click behaviors, while it is relatively mitigated in user purchase behaviors. Insights from the results guide the refinement of recommendation algorithms in real-world e-commerce systems.


title: Partial Data Inverse Problems for Nonlinear Magnetic Schr\"odinger Equations

abstract: We prove that the knowledge of the Dirichlet-to-Neumann map, measured on a part of the boundary of a bounded domain in $\mathbb{R}^n, n\geq2$, can uniquely determine, in a nonlinear magnetic Schr\"odinger equation, the vector-valued magnetic potential and the scalar electric potential, both being nonlinear in the solution.


title: Adjusted Logistic Propensity Weighting Methods for Population Inference using Nonprobability Volunteer-Based Epidemiologic Cohorts

abstract: Many epidemiologic studies forgo probability sampling and turn to nonprobability volunteer-based samples because of cost, response burden, and invasiveness of biological samples. However, finite population inference is difficult to make from the nonprobability samples due to the lack of population representativeness. Aiming for making inferences at the population level using nonprobability samples, various inverse propensity score weighting (IPSW) methods have been studied with the propensity defined by the participation rate of population units in the nonprobability sample. In this paper, we propose an adjusted logistic propensity weighting (ALP) method to estimate the participation rates for nonprobability sample units. Compared to existing IPSW methods, the proposed ALP method is easy to implement by ready-to-use software while producing approximately unbiased estimators for population quantities regardless of the nonprobability sample rate. The efficiency of the ALP estimator can be further improved by scaling the survey sample weights in propensity estimation. Taylor linearization variance estimators are proposed for ALP estimators of finite population means that account for all sources of variability. The proposed ALP methods are evaluated numerically via simulation studies and empirically using the na\"ive unweighted National Health and Nutrition Examination Survey III sample, while taking the 1997 National Health Interview Survey as the reference, to estimate the 15-year mortality rates.


title: From A Systematic Investigation of Faculty-Produced Think-Pair-Share Questions to Frameworks for Characterizing and Developing Fluency-Inspiring Activities

abstract: Our investigation of 353 faculty-produced multiple-choice Think-Pair-Share questions leads to key insights into faculty members' ideas about the discipline representations and intellectual tasks that could engage learners on key topics in physics and astronomy. The results of this work illustrate that, for many topics, there is a lack of variety in the representations featured, intellectual tasks posed, and levels of complexity fostered by the questions faculty develop. These efforts motivated and informed the development of two frameworks: (1) a curriculum characterization framework that allows us to systematically code active learning strategies in terms of the discipline representations, intellectual tasks, and reasoning complexity that an activity offers the learner; and (2) a curriculum development framework that guides the development of activities deliberately focused on increasing learners' discipline fluency. We analyze the faculty-produced Think-Pair-Share questions with our curriculum characterization framework, then apply our curriculum development framework to generate (1) Fluency-Inspiring Questions, a more pedagogically powerful extension of a well-established instructional strategy, and (2) Student Representation Tasks, a brand new type of instructional activity in astronomy that shifts the responsibility for generating appropriate representations onto the learners. We explicitly unpack and provide examples of Fluency-Inspiring Questions and Student Representation Tasks, detailing their usage of Pedagogical Discipline Representations coupled with novel question and activity formats.


title: Learning Personalized Risk Preferences for Recommendation

abstract: The rapid growth of e-commerce has made people accustomed to shopping online. Before making purchases on e-commerce websites, most consumers tend to rely on rating scores and review information to make purchase decisions. With this information, they can infer the quality of products to reduce the risk of purchase. Specifically, items with high rating scores and good reviews tend to be less risky, while items with low rating scores and bad reviews might be risky to purchase. On the other hand, the purchase behaviors will also be influenced by consumers' tolerance of risks, known as the risk attitudes. Economists have studied risk attitudes for decades. These studies reveal that people are not always rational enough when making decisions, and their risk attitudes may vary in different circumstances. Most existing works over recommendation systems do not consider users' risk attitudes in modeling, which may lead to inappropriate recommendations to users. For example, suggesting a risky item to a risk-averse person or a conservative item to a risk-seeking person may result in the reduction of user experience. In this paper, we propose a novel risk-aware recommendation framework that integrates machine learning and behavioral economics to uncover the risk mechanism behind users' purchasing behaviors. Concretely, we first develop statistical methods to estimate the risk distribution of each item and then draw the Nobel-award winning Prospect Theory into our model to learn how users choose from probabilistic alternatives that involve risks, where the probabilities of the outcomes are uncertain. Experiments on several e-commerce datasets demonstrate that our approach can achieve better performance than many classical recommendation approaches, and further analyses also verify the advantages of risk-aware recommendation beyond accuracy.


title: Quantization of deformed cluster Poisson varieties

abstract: Fock and Goncharov described a quantization of cluster $\mathcal{X}$-varieties (also known as cluster Poisson varieties) in [FG09]. Meanwhile, families of deformations of cluster $\mathcal{X}$-varieties were introduced in [BFMNC18]. In this paper we show that the two constructions are compatible -- we extend the Fock-Goncharov quantization of $\mathcal{X}$-varieties to the families of [BFMNC18]. As a corollary, we obtain that these families and each of their fibers have Poisson structures. We relate this construction to the Berenstein-Zelevinsky quantization of $\mathcal{A}$-varieties ([BZ05]). Finally, inspired by the counter-example to quantum positivity of the quantum greedy basis in [LLRZ14], we compute a counter-example to quantum positivity of the quantum theta basis.


title: ResNeXt and Res2Net Structures for Speaker Verification

abstract: The ResNet-based architecture has been widely adopted to extract speaker embeddings for text-independent speaker verification systems. By introducing the residual connections to the CNN and standardizing the residual blocks, the ResNet structure is capable of training deep networks to achieve highly competitive recognition performance. However, when the input feature space becomes more complicated, simply increasing the depth and width of the ResNet network may not fully realize its performance potential. In this paper, we present two extensions of the ResNet architecture, ResNeXt and Res2Net, for speaker verification. Originally proposed for image recognition, the ResNeXt and Res2Net introduce two more dimensions, cardinality and scale, in addition to depth and width, to improve the model's representation capacity. By increasing the scale dimension, the Res2Net model can represent multi-scale features with various granularities, which particularly facilitates speaker verification for short utterances. We evaluate our proposed systems on three speaker verification tasks. Experiments on the VoxCeleb test set demonstrated that the ResNeXt and Res2Net can significantly outperform the conventional ResNet model. The Res2Net model achieved superior performance by reducing the EER by 18.5% relative. Experiments on the other two internal test sets of mismatched conditions further confirmed the generalization of the ResNeXt and Res2Net architectures against noisy environment and segment length variations.


title: Detection of quantum geometric tensor by nonlinear optical response

abstract: Quantum geometric tensor (QGT), including a symmetric real part defined as quantum metric and an antisymmetric part defined as Berry curvature, is essential for understanding many phenomena. We studied the photogalvanic effect of a multiple-band system with time-reversal-invariant symmetry by theoretical analysis in this work. We concluded that the integral of gradient of the symmetric part of QGT in momentum space is related to the linearly photogalvanic effect, while the integral of gradient of Berry curvature is related to the circularly photogalvanic effect. Our work afforded an alternative interpretation for the photogalvanic effect in the view of QGT, and a simple approach to detect the QGT by nonlinear optical response.


title: Automatic semantic segmentation for prediction of tuberculosis using lens-free microscopy images

abstract: Tuberculosis (TB), caused by a germ called Mycobacterium tuberculosis, is one of the most serious public health problems in Peru and the world. The development of this project seeks to facilitate and automate the diagnosis of tuberculosis by the MODS method and using lens-free microscopy, due they are easier to calibrate and easier to use (by untrained personnel) in comparison with lens microscopy. Thus, we employ a U-Net network in our collected dataset to perform the automatic segmentation of the TB cords in order to predict tuberculosis. Our initial results show promising evidence for automatic segmentation of TB cords.


title: Star product representation of coherent state path integrals

abstract: In this paper, we determine the star product representation of coherent path integrals. By employing the properties of generalized delta functions with complex arguments, the Glauber-Sudarshan P-function corresponding to a non-diagonal density operator is obtained. Then, we compute the Husimi-Kano Q-representation of the time evolution operator in terms of the normal star product. Finally, the optical equivalence theorem allows us to express the coherent state path integral as a star exponential of the Hamiltonian function for the normal product.


title: Logic, Language, and Calculus

abstract: The difference between object-language and metalanguage is crucial for logical analysis, but has yet not been examined for the field of computer science. In this paper the difference is examined with regard to inferential relations. It is argued that inferential relations in a metalanguage (like a calculus for propositional logic) cannot represent conceptual relations of natural language. Inferential relations govern our concept use and understanding. Several approaches in the field of Natural Language Understanding (NLU) and Natural Language Inference (NLI) take this insight in account, but do not consider, how an inference can be assessed as a good inference. I present a logical analysis that can assesss the normative dimension of inferences, which is a crucial part of logical understanding and goes beyond formal understanding of metalanguages.


title: The weak Lefschetz property of Gorenstein algebras of codimension three associated to the Ap\'ery sets

abstract: It has been conjectured that {\it all} graded Artinian Gorenstein algebras of codimension three have the weak Lefschetz property over a field of characteristic zero. In this paper, we study the weak Lefschetz property of associated graded algebras $A$ of the Ap\'ery set of $M$-pure symmetric numerical semigroups generated by four natural numbers. In 2010, Bryant proved that these algebras are graded Artinian Gorenstein algebras of codimension three. In a recent article, Guerrieri showed that if $A$ is not a complete intersection, then $A$ is of form $A=R/I$ with $R=K[x,y,z]$ and \begin{align*} I=(x^a, y^b-x^{b-\gamma} z^\gamma, z^c, x^{a-b+\gamma}y^{b-\beta}, y^{b-\beta}z^{c-\gamma}), \end{align*} where $ 1\leq \beta\leq b-1,\; \max\{1, b-a+1 \}\leq \gamma\leq \min \{b-1,c-1\}$ and $a\geq c\geq 2$. We prove that $A$ has the weak Lefschetz property in the following cases: (a) $ \max\{1,b-a+c-1\}\leq \beta\leq b-1$ and $\gamma\geq \lfloor\frac{\beta-a+b+c-2}{2}\rfloor$; (b) $ a\leq 2b-c$ and $| a-b| +c-1\leq \beta\leq b-1$; (c) one of $a,b,c$ is at most five.


title: Regularization Matters: A Nonparametric Perspective on Overparametrized Neural Network

abstract: Overparametrized neural networks trained by gradient descent (GD) can provably overfit any training data. However, the generalization guarantee may not hold for noisy data. From a nonparametric perspective, this paper studies how well overparametrized neural networks can recover the true target function in the presence of random noises. We establish a lower bound on the $L_2$ estimation error with respect to the GD iterations, which is away from zero without a delicate scheme of early stopping. In turn, through a comprehensive analysis of $\ell_2$-regularized GD trajectories, we prove that for overparametrized one-hidden-layer ReLU neural network with the $\ell_2$ regularization: (1) the output is close to that of the kernel ridge regression with the corresponding neural tangent kernel; (2) minimax {optimal} rate of $L_2$ estimation error can be achieved. Numerical experiments confirm our theory and further demonstrate that the $\ell_2$ regularization approach improves the training robustness and works for a wider range of neural networks.


title: Inferences and Modal Vocabulary

abstract: Deduction is the one of the major forms of inferences and commonly used in formal logic. This kind of inference has the feature of monotonicity, which can be problematic. There are different types of inferences that are not monotonic, e.g. abductive inferences. The debate between advocates and critics of abduction as a useful instrument can be reconstructed along the issue, how an abductive inference warrants to pick out one hypothesis as the best one. But how can the goodness of an inference be assessed? Material inferences express good inferences based on the principle of material incompatibility. Material inferences are based on modal vocabulary, which enriches the logical expressivity of the inferential relations. This leads also to certain limits in the application of labeling in machine learning. I propose a modal interpretation of implications to express conceptual relations.